Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [X....X.X.........XXX.X...X.X............................X.X.] duration: 6.885629293s FAIL (2025-09-13 15:38:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.88567013s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.X....X.X.........XXX.X...X.X............................X.X] duration: 30.001091864s FAIL (2025-09-13 15:38:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001127143s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 9.168467068s FAIL (2025-09-13 15:38:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.168491395s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X...X....................................................] duration: 19.505267811s FAIL (2025-09-13 15:37:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 19.505289642s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X...X...................................................] duration: 14.573124685s FAIL (2025-09-13 15:37:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 14.573149393s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [X.X....X.X.........XXX.X...X.X............................X.] duration: 7.504092397s FAIL (2025-09-13 15:36:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.504119501s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 9.873553332s FAIL (2025-09-13 15:36:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.873582209s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 8.57999892s FAIL (2025-09-13 15:36:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.580024699s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.X.X....X.X.........XXX.X...X.X............................X] duration: 30.000775048s FAIL (2025-09-13 15:36:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000802501s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X...X..................................................] duration: 18.140739366s FAIL (2025-09-13 15:36:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 18.14076739s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X...X.................................................] duration: 13.764206747s FAIL (2025-09-13 15:36:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 13.764243306s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 8.591744649s FAIL (2025-09-13 15:35:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.591799423s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X...X................................................] duration: 19.118527193s FAIL (2025-09-13 15:35:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 19.118553845s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..X.X....X.X.........XXX.X...X.X............................] duration: 7.867251249s FAIL (2025-09-13 15:35:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.867274813s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 8.340050672s FAIL (2025-09-13 15:34:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.34007043s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X...X...............................................] duration: 18.054620536s FAIL (2025-09-13 15:34:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 18.05464928s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [...X.X....X.X.........XXX.X...X.X...........................] duration: 6.795659838s FAIL (2025-09-13 15:34:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.79568085s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 8.023279048s FAIL (2025-09-13 15:34:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.023352248s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 8.568843777s FAIL (2025-09-13 15:33:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.568864368s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X...X..............................................] duration: 16.329402292s FAIL (2025-09-13 15:33:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 16.329429203s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [X...X.X....X.X.........XXX.X...X.X..........................] duration: 7.337760156s FAIL (2025-09-13 15:33:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.337785766s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 9.645619484s FAIL (2025-09-13 15:32:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.645641815s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X...X.............................................] duration: 11.957090462s FAIL (2025-09-13 15:32:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 11.957114057s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.X...X.X....X.X.........XXX.X...X.X.........................] duration: 7.561583375s FAIL (2025-09-13 15:32:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.561610285s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X...X............................................] duration: 16.17970208s FAIL (2025-09-13 15:32:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 16.179726978s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 9.124229582s FAIL (2025-09-13 15:31:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.124288034s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X...X...........................................] duration: 16.63689332s FAIL (2025-09-13 15:31:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 16.636917657s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..X...X.X....X.X.........XXX.X...X.X........................] duration: 7.236692997s FAIL (2025-09-13 15:31:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.236724377s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [X..X...X.X....X.X.........XXX.X...X.X.......................] duration: 6.819340287s FAIL (2025-09-13 15:30:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.819366436s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 9.298054474s FAIL (2025-09-13 15:30:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.29807771s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration: 14.896255667s FAIL (2025-09-13 15:30:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 14.896282149s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 8.214484357s FAIL (2025-09-13 15:29:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.214510787s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration: 16.964799342s FAIL (2025-09-13 15:29:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 16.964826926s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.X..X...X.X....X.X.........XXX.X...X.X......................] duration: 7.187581207s FAIL (2025-09-13 15:29:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.18760421s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X...X........................................] duration: 17.340533605s FAIL (2025-09-13 15:29:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 17.340561509s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..X..X...X.X....X.X.........XXX.X...X.X.....................] duration: 7.50890932s FAIL (2025-09-13 15:29:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.508931282s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 8.205413205s FAIL (2025-09-13 15:28:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.205433924s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X...X.......................................] duration: 19.252149523s FAIL (2025-09-13 15:28:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 19.252177117s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...X..X...X.X....X.X.........XXX.X...X.X....................] duration: 7.314344192s FAIL (2025-09-13 15:28:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.314368709s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 10.049661586s FAIL (2025-09-13 15:27:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.04968952s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X...X......................................] duration: 15.23319028s FAIL (2025-09-13 15:27:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 15.233215448s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....X..X...X.X....X.X.........XXX.X...X.X...................] duration: 6.52519468s FAIL (2025-09-13 15:27:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.525225891s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 9.200906576s FAIL (2025-09-13 15:27:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.200934329s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....X..X...X.X....X.X.........XXX.X...X.X..................] duration: 7.169438055s FAIL (2025-09-13 15:26:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.169456121s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......X..X...X.X....X.X.........XXX.X...X.X.................] duration: 6.995347011s FAIL (2025-09-13 15:26:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.995364183s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration: 14.853968264s FAIL (2025-09-13 15:26:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 14.854001016s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 9.23888678s FAIL (2025-09-13 15:26:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.23891302s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......X..X...X.X....X.X.........XXX.X...X.X................] duration: 6.911331639s FAIL (2025-09-13 15:26:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.911344466s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X...X....................................] duration: 14.764151473s FAIL (2025-09-13 15:25:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== 6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.907845810 (169h26m51.94741893s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908062555 (169h26m51.947635675s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908276674 (169h26m51.947849794s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:15.908522154 (169h26m51.948095274s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Uploading piece... Sep 13 14:55:17.522666509 (169h26m53.562239629s) [upload=148985]: Next returned nil segment Sep 13 14:55:17.522686247 (169h26m53.562259367s) [upload=148985]: Waiting for error group managing segments... Sep 13 14:55:18.048737965 (169h26m54.088311085s) [noise=true , address=77.90.31.17:4793 , piece_id=PWVTHYWQY6GFO5FCIBANYNSX72VNUGT4UXKYI5CEIIHNZGNB63OA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.323717226 (169h26m54.363290346s) [noise=true , address=77.90.31.11:4559 , piece_id=OYMOQVJRZ6SMMF7O2DXXDEOVRN27B3FT5EIVMFFBHC47UPZUUMIQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:55:18.769215263 (169h26m54.808788383s) [noise=true , address=45.91.116.14:4221 , piece_id=Q7ZPEITLUERUPOI247KAARIL3GSAPW6JNEUF7FSHQWJHL5GTGIZQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: <nil> Sep 13 14:56:14.598217910 (169h27m50.63779103s) [noise=true , address=145.79.227.28:4730 , piece_id=5WCQINYSLLWZR3Z3QWWUKRKDPRWYQ6VQPIZ4YDAD47JHSKDSCAGA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:42820->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598245002 (169h27m50.637818122s) [noise=true , address=145.79.227.52:4475 , piece_id=3T3MRZJ2T74J7CB5EJ4N2CIIERKWTQ5KWIOLDNV2LXHYLO5IKHTA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:145.79.227.52:4475): protocol: rpc: dial tcp 145.79.227.52:4475: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598273767 (169h27m50.637846887s) [noise=true , address=145.79.227.50:4386 , piece_id=74QVIDRRHFRIA5Z6ZAQ4EWQ2PZ5HZI5JXNJ5WR2DVFJQ4WGE2UPQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:19aPjJnya2Q3stEhiedDSth3NHV8phLRj5yY79hZv81UgDitMv, address:145.79.227.50:4386): protocol: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42008->145.79.227.50:4386: use of closed network connection Sep 13 14:56:14.598293245 (169h27m50.637866365s) [noise=true , address=145.79.227.5:4250 , piece_id=EPZOZXRFVPSAPD6UKPOCCBOX7VJNB4DQRKV6YTRWMPOLQQ5IH6KQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM, address:145.79.227.5:4250): protocol: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58078->145.79.227.5:4250: use of closed network connection Sep 13 14:56:14.598308794 (169h27m50.637881914s) [noise=true , address=145.79.227.33:4894 , piece_id=5KD2BL5J7DT7JDLPDS2QUUMM26AFWSXJ2BDTJSUGZ253ZV7XOVKQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44, address:145.79.227.33:4894): protocol: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53614->145.79.227.33:4894: use of closed network connection Sep 13 14:56:14.598327330 (169h27m50.63790045s) [noise=true , address=145.79.227.7:4308 , piece_id=FYL7PQOKW74EJ2QLKMN6EYJKIT7A6B2VQESVP2VFVDVJHPHXFGAQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY, address:145.79.227.7:4308): protocol: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37146->145.79.227.7:4308: use of closed network connection Sep 13 14:56:14.598358169 (169h27m50.637931289s) [noise=true , address=145.79.227.36:4544 , piece_id=WZRHCCBJDHID4R4UOB76OABJSH2QVC6WZ6OZWIUUMKWWBDVWEG4A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12RSxwxw1WXkNcu7b3dEgJhyNkFGYUfKF4QVKmK323L5g3EKFnG, address:145.79.227.36:4544): protocol: rpc: dial tcp 145.79.227.36:4544: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598387545 (169h27m50.637960665s) [noise=true , address=145.79.227.2:4137 , piece_id=NH4RZXYD3LKQZLLP5SSA7HXC7FBBOQV6QLBE2B3R5HH5F23Q7E6A, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12tkbodtFrNCuJbvZk8YnpSdJfVsKasNuKhg2wGD8rDkNPrHZ21, address:145.79.227.2:4137): protocol: rpc: dial tcp 145.79.227.2:4137: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598421721 (169h27m50.637994841s) [noise=true , address=145.79.227.30:4780 , piece_id=7EMNYDLOMVLIDGE5ZK7WFQCNGBFLZA5AF5EHSLHYE22XJ2MP56VQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:125WCbZ6a2NaewiLAHhHuPo91sQEfC9CZzEBV6rwF1JY7z13AEY, address:145.79.227.30:4780): protocol: read tcp 188.166.225.170:43016->145.79.227.30:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598427161 (169h27m50.638000281s) [noise=true , address=145.79.227.19:4090 , piece_id=YZ2H4UUM3Z5ZMCC6LQDAPLHCT7OQQAMRSDBQ3CH6I6UT2HAN4TXQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:145.79.227.19:4090): protocol: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37110->145.79.227.19:4090: use of closed network connection Sep 13 14:56:14.598456818 (169h27m50.638029938s) [noise=true , address=145.79.227.10:4425 , piece_id=CRES4FQPX4WMTDTUBCPRZ2R4OHTI7MMHS6XSCZ7UXKDLSSLEVQ3Q, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:145.79.227.10:4425): protocol: read tcp 188.166.225.170:58348->145.79.227.10:4425: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598463220 (169h27m50.63803635s) [noise=true , address=145.79.227.35:4501 , piece_id=UKSF2KK675OI35QE6QZTH7QAJQ4SD7E42ZPMY2JIANOHGEFF44UQ, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1hmsSAiSp1CBFqKhVE2S3sFfqYYkGVAiV1GfrT4Rd7hBaFNPpT, address:145.79.227.35:4501): protocol: rpc: dial tcp 145.79.227.35:4501: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598484230 (169h27m50.63805735s) [noise=true , address=145.79.227.14:4867 , piece_id=7BW6OXJYXIXQSQK3DMHSGQ56ANOAOEGXEHD4EWCOZDXTTIL37SAA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE, address:145.79.227.14:4867): protocol: read tcp 188.166.225.170:60252->145.79.227.14:4867: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598492155 (169h27m50.638065275s) [noise=true , address=145.79.227.18:4018 , piece_id=72FTA6TNIQAVS2NDA5XOR4J2ZEEBWZ7LLGT4EAQ2EN2YB3VXG5JA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:1bFRHbXjTaxoEKc5gbQWYt6jwUg8jknScBZpc8PdKNSZhYqUqP, address:145.79.227.18:4018): protocol: read tcp 188.166.225.170:60682->145.79.227.18:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598496193 (169h27m50.638069313s) [noise=true , address=145.79.227.47:4286 , piece_id=D2PSYV2IN5MFZGGF2U47EPRTCNDIMHB74GR3UFQ64AJN37FE7BVA, seg_pos={0 0}, upload=148985]: Done uploading piece. err: ecclient: upload failed (node:12v2vJnE92VrJXQrbxnAxANHCVASuXiBKMUZECMVmEWEjsZRtsQ, address:145.79.227.47:4286): protocol: read tcp 188.166.225.170:33092->145.79.227.47:4286: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 13 14:56:14.598521301 (169h27m50.638094421s) [seg_pos={0 0}, upload=148985]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Sep 13 14:56:14.862062924 (169h27m50.901636044s) [upload=148985]: Done uploading segments... Sep 13 14:56:14.862090337 (169h27m50.901663457s) [upload=148985]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 14.764180618s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........X..X...X.X....X.X.........XXX.X...X.X...............] duration: 7.247966556s FAIL (2025-09-13 15:25:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.247987977s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)