Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X........X.....X........................] duration: 6.272996765s FAIL (2025-08-21 10:17:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 6.273025971s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X........X.....X.......................] duration: 5.880694509s FAIL (2025-08-21 10:16:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.880718487s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [..........X.XX.....................X..X.....X.....X.........] duration: 1.849919923s FAIL (2025-08-21 10:15:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.849962085s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X........X.....X......................] duration: 5.91764514s FAIL (2025-08-21 10:15:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.917672001s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [...........X.XX.....................X..X.....X.....X........] duration: 2.006723351s FAIL (2025-08-21 10:14:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 2.006752626s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X........X.....X.....................] duration: 5.65276198s FAIL (2025-08-21 10:14:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.652786058s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [............X.XX.....................X..X.....X.....X.......] duration: 1.921929247s FAIL (2025-08-21 10:13:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.921945578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X........X.....X....................] duration: 5.831292257s FAIL (2025-08-21 10:13:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.831323727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.............X.XX.....................X..X.....X.....X......] duration: 2.000069366s FAIL (2025-08-21 10:12:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 2.000094276s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [..............X.XX.....................X..X.....X.....X.....] duration: 1.84059675s FAIL (2025-08-21 10:12:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.840623982s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X........................X........X.....X...................] duration: 5.725587613s FAIL (2025-08-21 10:11:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.725605648s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [...............X.XX.....................X..X.....X.....X....] duration: 1.813336811s FAIL (2025-08-21 10:11:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.813367208s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 8 out of 60 is failed (threshold=3) [X...............X.XX.....................X..X.....X.....X...] duration: 1.865479196s FAIL (2025-08-21 10:10:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.865506908s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X........................X........X.....X..................] duration: 5.596304162s FAIL (2025-08-21 10:10:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.596333948s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 8 out of 60 is failed (threshold=3) [.X...............X.XX.....................X..X.....X.....X..] duration: 1.997040792s FAIL (2025-08-21 10:10:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.997060059s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X........................X........X.....X.................] duration: 5.624076194s FAIL (2025-08-21 10:09:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.624095951s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X........................X........X.....X................] duration: 5.571322075s FAIL (2025-08-21 10:09:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.57134483s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 8 out of 60 is failed (threshold=3) [..X...............X.XX.....................X..X.....X.....X.] duration: 1.821404776s FAIL (2025-08-21 10:09:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.821431858s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 3.853188166s FAIL (2025-08-21 10:09:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.853217371s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 3.848221707s FAIL (2025-08-21 10:08:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.848246514s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X........................X........X.....X...............] duration: 5.554571349s FAIL (2025-08-21 10:08:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.554605674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 8 out of 60 is failed (threshold=3) [...X...............X.XX.....................X..X.....X.....X] duration: 1.593579902s FAIL (2025-08-21 10:08:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:08:16.064338121 (304h42m10.495418272s) [upload=316951]: Starting upload Aug 21 10:08:16.064440106 (304h42m10.495520237s) [upload=316951]: Done starting upload Aug 21 10:08:16.064504609 (304h42m10.49558481s) [upload=316951]: Uploading segments... Aug 21 10:08:16.064599030 (304h42m10.495679161s) [upload=316951]: Got next segment. Inline: true Aug 21 10:08:16.064607206 (304h42m10.495687367s) [upload=316951]: Waiting for error group managing segments... Aug 21 10:08:16.064686197 (304h42m10.495766328s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:08:16.064694352 (304h42m10.495774483s) [upload=316951]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:08:16.064699302 (304h42m10.495779443s) [upload=316951]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:08:16.342785945 (304h42m10.773866076s) [upload=316951]: Done uploading segments... Aug 21 10:08:16.342808659 (304h42m10.77388884s) [upload=316951]: Upload finished. err: <nil> Duration:* 1.593598387s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X........................X........X.....X..............] duration: 5.530495691s FAIL (2025-08-21 10:08:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.530521541s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [....X...............X.XX.....................X..X.....X.....] duration: 1.82398299s FAIL (2025-08-21 10:07:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.824006484s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 3.909808503s FAIL (2025-08-21 10:07:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.909842138s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 3.932542221s FAIL (2025-08-21 10:07:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.932570424s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X........................X........X.....X.............] duration: 5.54675015s FAIL (2025-08-21 10:07:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.546779887s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.....X...............X.XX.....................X..X.....X....] duration: 1.830332109s FAIL (2025-08-21 10:06:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.830362887s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 3.90053929s FAIL (2025-08-21 10:06:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.900564929s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X........................X........X.....X............] duration: 5.854585797s FAIL (2025-08-21 10:06:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.85461899s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 3.894742886s FAIL (2025-08-21 10:06:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.894996139s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [......X...............X.XX.....................X..X.....X...] duration: 1.827749536s FAIL (2025-08-21 10:05:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.827767489s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X........................X........X.....X...........] duration: 5.945241019s FAIL (2025-08-21 10:05:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.945267409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X........................X........X.....X..........] duration: 5.826644971s FAIL (2025-08-21 10:05:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.826673095s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 3.888425306s FAIL (2025-08-21 10:05:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.888453981s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.......X...............X.XX.....................X..X.....X..] duration: 2.018807502s FAIL (2025-08-21 10:04:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 2.018831727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X........................X........X.....X.........] duration: 5.692336664s FAIL (2025-08-21 10:04:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.692353596s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 3.865115487s FAIL (2025-08-21 10:04:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.865151515s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [........X...............X.XX.....................X..X.....X.] duration: 1.81068671s FAIL (2025-08-21 10:04:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.810713832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X........................X........X.....X........] duration: 5.492251774s FAIL (2025-08-21 10:04:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.492288055s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X........................X........X.....X.......] duration: 5.703082902s FAIL (2025-08-21 10:03:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.703103802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.........X...............X.XX.....................X..X.....X] duration: 1.571097376s FAIL (2025-08-21 10:03:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.571126199s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 3.95157141s FAIL (2025-08-21 10:03:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.951601658s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X........................X........X.....X......] duration: 5.705499341s FAIL (2025-08-21 10:03:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.705526041s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 3.866135118s FAIL (2025-08-21 10:03:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.866174764s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X...............X.XX.....................X..X.....] duration: 1.924599837s FAIL (2025-08-21 10:02:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.924636207s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X........................X........X.....X.....] duration: 5.668489954s FAIL (2025-08-21 10:02:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.668521375s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 4.042304458s FAIL (2025-08-21 10:02:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 4.042330759s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...........X...............X.XX.....................X..X....] duration: 1.976526432s FAIL (2025-08-21 10:02:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.97655185s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X........................X........X.....X....] duration: 5.570743661s FAIL (2025-08-21 10:02:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.570776824s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)