Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................................................XX...] duration: 3.446478556s trace: https://jaeger.dev.storj.io/trace/1a875a21fbc9493b FAIL (2025-11-02 20:01:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.446625366s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................................................XX..] duration: 3.36774435s trace: https://jaeger.dev.storj.io/trace/1a875a21fbc9493b FAIL (2025-11-02 20:00:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.367772102s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.889530407s trace: https://jaeger.dev.storj.io/trace/6469a32319fb23c3 FAIL (2025-11-02 20:00:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 5) ======LOGS====== _id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.939448529 (80h17m28.635297282s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940316662 (80h17m28.636165416s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940854095 (80h17m28.636702838s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941163254 (80h17m28.637011997s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941597421 (80h17m28.637446175s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.944379569 (80h17m28.640228322s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945350588 (80h17m28.641199341s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945999965 (80h17m28.641848708s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.946799317 (80h17m28.64264806s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949026458 (80h17m28.644875211s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949648072 (80h17m28.645496815s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:58.374326863 (80h17m30.070175616s) [upload=70665]: Next returned nil segment Nov 2 19:57:58.374346910 (80h17m30.070195674s) [upload=70665]: Waiting for error group managing segments... Nov 2 19:57:58.737256438 (80h17m30.433105181s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.932997019 (80h17m30.628845773s) [noise=true , address=45.91.116.8:4046 , piece_id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.948107422 (80h17m30.643956175s) [noise=true , address=77.90.31.19:4861 , piece_id=DPE7KWFAPMTW67GEMLT2YCBXVMLY75BAU7BLRRYN2UBDIWHUZNJQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.005265203 (80h17m30.701113946s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.052320256 (80h17m30.748169009s) [noise=true , address=77.90.31.13:4658 , piece_id=ZTX6WQ5M3TTA7KUKMJVKWHQHLMRMJW5EUUFVBRBQZDVBFZWWKZQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:58:55.966307021 (80h18m27.662155784s) [noise=true , address=145.79.227.3:4169 , piece_id=GCSPGUWUFDXU2TZ6BNUAEU75A4RUKYCRERUPQRD326RXSDAX7ATQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX, address:145.79.227.3:4169): protocol: rpc: dial tcp 145.79.227.3:4169: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966419525 (80h18m27.662268268s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K, address:145.79.227.13:4833): protocol: rpc: dial tcp 145.79.227.13:4833: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966726459 (80h18m27.662575212s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1MGCEjVE57ej5VuXgC6pYPFNUuAL851p2gqC53xxj6hEXvgYM5, address:145.79.227.18:4030): protocol: rpc: dial tcp 145.79.227.18:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966930668 (80h18m27.662779421s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1F5oTP56RsDAA7Yde8hYvq7Lx5tiFDUHoBvPrYnhQiFy2Rko3N, address:145.79.227.38:4995): protocol: read tcp 188.166.225.170:59394->145.79.227.38:4995: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967260457 (80h18m27.66310921s) [noise=true , address=145.79.227.41:4097 , piece_id=ANQYF4KYYUUGFNUOHEINXGP2VQATR2LNVY6L55FA5FOL5HNAJRGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1sMhTktqf2H4aZSyFV3m9Z6eMVxL2U52bvUHVHUh2gUCVp32AM, address:145.79.227.41:4097): protocol: rpc: dial tcp 145.79.227.41:4097: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967696617 (80h18m27.66354536s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX, address:145.79.227.48:4310): protocol: rpc: dial tcp 145.79.227.48:4310: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967744338 (80h18m27.663593081s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9, address:145.79.227.8:4357): protocol: rpc: dial tcp 145.79.227.8:4357: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967941153 (80h18m27.663789906s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72, address:145.79.227.49:4346): protocol: read tcp 188.166.225.170:47702->145.79.227.49:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967952104 (80h18m27.663800847s) [noise=true , address=145.79.227.5:4242 , piece_id=54VY4XFFRB3G5P7VLHFAFUJQTVHVIEHKK2TZT4PNQUOUIFME7MFA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz, address:145.79.227.5:4242): protocol: rpc: dial tcp 145.79.227.5:4242: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968005255 (80h18m27.663854008s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:126wqKRVvj3engw69RJSmdgdB91qMyG1Ed5XfUCpu3ZGq3uXSbe, address:145.79.227.37:4587): protocol: rpc: dial tcp 145.79.227.37:4587: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968119682 (80h18m27.663968426s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1kgUqvw1r3gSKw1bNjzys3AiAJXdkAnSafmvcPgNVPBbN9JS1d, address:145.79.227.46:4602): protocol: read tcp 188.166.225.170:54484->145.79.227.46:4602: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968176942 (80h18m27.664025695s) [noise=true , address=145.79.227.43:4180 , piece_id=62QSVFJI44O5UMXM7SBZXY7SRMH6ZYSDD23OKDX5WXRLQCYNSXTQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1rhkcipPBZNFScBjBhWdigzSMwENSmzhCucnC2iuyc9udpweE3, address:145.79.227.43:4180): protocol: read tcp 188.166.225.170:48566->145.79.227.43:4180: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968252796 (80h18m27.664101549s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1VzewCRbNpJv7kNwp9wruQuoVSaZFjA44qN33Ct7qm1GnfhtDj, address:145.79.227.45:4237): protocol: read tcp 188.166.225.170:60808->145.79.227.45:4237: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968277563 (80h18m27.664126306s) [seg_pos={0 0}, upload=70665]: Done waiting for segment. successful: 5 optimal: 14 errs: <nil> Nov 2 19:58:56.213414304 (80h18m27.909263047s) [upload=70665]: Done uploading segments... Nov 2 19:58:56.213452137 (80h18m27.90930088s) [upload=70665]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 5) Duration: 5.889564341s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.660554308s trace: https://jaeger.dev.storj.io/trace/6469a32319fb23c3 FAIL (2025-11-02 19:59:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 5) ======LOGS====== _id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.939448529 (80h17m28.635297282s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940316662 (80h17m28.636165416s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940854095 (80h17m28.636702838s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941163254 (80h17m28.637011997s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941597421 (80h17m28.637446175s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.944379569 (80h17m28.640228322s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945350588 (80h17m28.641199341s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945999965 (80h17m28.641848708s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.946799317 (80h17m28.64264806s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949026458 (80h17m28.644875211s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949648072 (80h17m28.645496815s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:58.374326863 (80h17m30.070175616s) [upload=70665]: Next returned nil segment Nov 2 19:57:58.374346910 (80h17m30.070195674s) [upload=70665]: Waiting for error group managing segments... Nov 2 19:57:58.737256438 (80h17m30.433105181s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.932997019 (80h17m30.628845773s) [noise=true , address=45.91.116.8:4046 , piece_id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.948107422 (80h17m30.643956175s) [noise=true , address=77.90.31.19:4861 , piece_id=DPE7KWFAPMTW67GEMLT2YCBXVMLY75BAU7BLRRYN2UBDIWHUZNJQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.005265203 (80h17m30.701113946s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.052320256 (80h17m30.748169009s) [noise=true , address=77.90.31.13:4658 , piece_id=ZTX6WQ5M3TTA7KUKMJVKWHQHLMRMJW5EUUFVBRBQZDVBFZWWKZQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:58:55.966307021 (80h18m27.662155784s) [noise=true , address=145.79.227.3:4169 , piece_id=GCSPGUWUFDXU2TZ6BNUAEU75A4RUKYCRERUPQRD326RXSDAX7ATQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX, address:145.79.227.3:4169): protocol: rpc: dial tcp 145.79.227.3:4169: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966419525 (80h18m27.662268268s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K, address:145.79.227.13:4833): protocol: rpc: dial tcp 145.79.227.13:4833: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966726459 (80h18m27.662575212s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1MGCEjVE57ej5VuXgC6pYPFNUuAL851p2gqC53xxj6hEXvgYM5, address:145.79.227.18:4030): protocol: rpc: dial tcp 145.79.227.18:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966930668 (80h18m27.662779421s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1F5oTP56RsDAA7Yde8hYvq7Lx5tiFDUHoBvPrYnhQiFy2Rko3N, address:145.79.227.38:4995): protocol: read tcp 188.166.225.170:59394->145.79.227.38:4995: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967260457 (80h18m27.66310921s) [noise=true , address=145.79.227.41:4097 , piece_id=ANQYF4KYYUUGFNUOHEINXGP2VQATR2LNVY6L55FA5FOL5HNAJRGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1sMhTktqf2H4aZSyFV3m9Z6eMVxL2U52bvUHVHUh2gUCVp32AM, address:145.79.227.41:4097): protocol: rpc: dial tcp 145.79.227.41:4097: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967696617 (80h18m27.66354536s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX, address:145.79.227.48:4310): protocol: rpc: dial tcp 145.79.227.48:4310: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967744338 (80h18m27.663593081s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9, address:145.79.227.8:4357): protocol: rpc: dial tcp 145.79.227.8:4357: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967941153 (80h18m27.663789906s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72, address:145.79.227.49:4346): protocol: read tcp 188.166.225.170:47702->145.79.227.49:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967952104 (80h18m27.663800847s) [noise=true , address=145.79.227.5:4242 , piece_id=54VY4XFFRB3G5P7VLHFAFUJQTVHVIEHKK2TZT4PNQUOUIFME7MFA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz, address:145.79.227.5:4242): protocol: rpc: dial tcp 145.79.227.5:4242: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968005255 (80h18m27.663854008s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:126wqKRVvj3engw69RJSmdgdB91qMyG1Ed5XfUCpu3ZGq3uXSbe, address:145.79.227.37:4587): protocol: rpc: dial tcp 145.79.227.37:4587: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968119682 (80h18m27.663968426s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1kgUqvw1r3gSKw1bNjzys3AiAJXdkAnSafmvcPgNVPBbN9JS1d, address:145.79.227.46:4602): protocol: read tcp 188.166.225.170:54484->145.79.227.46:4602: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968176942 (80h18m27.664025695s) [noise=true , address=145.79.227.43:4180 , piece_id=62QSVFJI44O5UMXM7SBZXY7SRMH6ZYSDD23OKDX5WXRLQCYNSXTQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1rhkcipPBZNFScBjBhWdigzSMwENSmzhCucnC2iuyc9udpweE3, address:145.79.227.43:4180): protocol: read tcp 188.166.225.170:48566->145.79.227.43:4180: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968252796 (80h18m27.664101549s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1VzewCRbNpJv7kNwp9wruQuoVSaZFjA44qN33Ct7qm1GnfhtDj, address:145.79.227.45:4237): protocol: read tcp 188.166.225.170:60808->145.79.227.45:4237: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968277563 (80h18m27.664126306s) [seg_pos={0 0}, upload=70665]: Done waiting for segment. successful: 5 optimal: 14 errs: <nil> Nov 2 19:58:56.213414304 (80h18m27.909263047s) [upload=70665]: Done uploading segments... Nov 2 19:58:56.213452137 (80h18m27.90930088s) [upload=70665]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 5) Duration: 5.66058228s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................................................XX.] duration: 3.325273716s trace: https://jaeger.dev.storj.io/trace/1a875a21fbc9493b FAIL (2025-11-02 19:59:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.32529642s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.708780662s trace: https://jaeger.dev.storj.io/trace/6469a32319fb23c3 FAIL (2025-11-02 19:59:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 5) ======LOGS====== _id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.939448529 (80h17m28.635297282s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940316662 (80h17m28.636165416s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940854095 (80h17m28.636702838s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941163254 (80h17m28.637011997s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941597421 (80h17m28.637446175s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.944379569 (80h17m28.640228322s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945350588 (80h17m28.641199341s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945999965 (80h17m28.641848708s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.946799317 (80h17m28.64264806s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949026458 (80h17m28.644875211s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949648072 (80h17m28.645496815s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:58.374326863 (80h17m30.070175616s) [upload=70665]: Next returned nil segment Nov 2 19:57:58.374346910 (80h17m30.070195674s) [upload=70665]: Waiting for error group managing segments... Nov 2 19:57:58.737256438 (80h17m30.433105181s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.932997019 (80h17m30.628845773s) [noise=true , address=45.91.116.8:4046 , piece_id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.948107422 (80h17m30.643956175s) [noise=true , address=77.90.31.19:4861 , piece_id=DPE7KWFAPMTW67GEMLT2YCBXVMLY75BAU7BLRRYN2UBDIWHUZNJQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.005265203 (80h17m30.701113946s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.052320256 (80h17m30.748169009s) [noise=true , address=77.90.31.13:4658 , piece_id=ZTX6WQ5M3TTA7KUKMJVKWHQHLMRMJW5EUUFVBRBQZDVBFZWWKZQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:58:55.966307021 (80h18m27.662155784s) [noise=true , address=145.79.227.3:4169 , piece_id=GCSPGUWUFDXU2TZ6BNUAEU75A4RUKYCRERUPQRD326RXSDAX7ATQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX, address:145.79.227.3:4169): protocol: rpc: dial tcp 145.79.227.3:4169: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966419525 (80h18m27.662268268s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K, address:145.79.227.13:4833): protocol: rpc: dial tcp 145.79.227.13:4833: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966726459 (80h18m27.662575212s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1MGCEjVE57ej5VuXgC6pYPFNUuAL851p2gqC53xxj6hEXvgYM5, address:145.79.227.18:4030): protocol: rpc: dial tcp 145.79.227.18:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966930668 (80h18m27.662779421s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1F5oTP56RsDAA7Yde8hYvq7Lx5tiFDUHoBvPrYnhQiFy2Rko3N, address:145.79.227.38:4995): protocol: read tcp 188.166.225.170:59394->145.79.227.38:4995: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967260457 (80h18m27.66310921s) [noise=true , address=145.79.227.41:4097 , piece_id=ANQYF4KYYUUGFNUOHEINXGP2VQATR2LNVY6L55FA5FOL5HNAJRGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1sMhTktqf2H4aZSyFV3m9Z6eMVxL2U52bvUHVHUh2gUCVp32AM, address:145.79.227.41:4097): protocol: rpc: dial tcp 145.79.227.41:4097: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967696617 (80h18m27.66354536s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX, address:145.79.227.48:4310): protocol: rpc: dial tcp 145.79.227.48:4310: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967744338 (80h18m27.663593081s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9, address:145.79.227.8:4357): protocol: rpc: dial tcp 145.79.227.8:4357: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967941153 (80h18m27.663789906s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72, address:145.79.227.49:4346): protocol: read tcp 188.166.225.170:47702->145.79.227.49:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967952104 (80h18m27.663800847s) [noise=true , address=145.79.227.5:4242 , piece_id=54VY4XFFRB3G5P7VLHFAFUJQTVHVIEHKK2TZT4PNQUOUIFME7MFA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz, address:145.79.227.5:4242): protocol: rpc: dial tcp 145.79.227.5:4242: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968005255 (80h18m27.663854008s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:126wqKRVvj3engw69RJSmdgdB91qMyG1Ed5XfUCpu3ZGq3uXSbe, address:145.79.227.37:4587): protocol: rpc: dial tcp 145.79.227.37:4587: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968119682 (80h18m27.663968426s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1kgUqvw1r3gSKw1bNjzys3AiAJXdkAnSafmvcPgNVPBbN9JS1d, address:145.79.227.46:4602): protocol: read tcp 188.166.225.170:54484->145.79.227.46:4602: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968176942 (80h18m27.664025695s) [noise=true , address=145.79.227.43:4180 , piece_id=62QSVFJI44O5UMXM7SBZXY7SRMH6ZYSDD23OKDX5WXRLQCYNSXTQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1rhkcipPBZNFScBjBhWdigzSMwENSmzhCucnC2iuyc9udpweE3, address:145.79.227.43:4180): protocol: read tcp 188.166.225.170:48566->145.79.227.43:4180: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968252796 (80h18m27.664101549s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1VzewCRbNpJv7kNwp9wruQuoVSaZFjA44qN33Ct7qm1GnfhtDj, address:145.79.227.45:4237): protocol: read tcp 188.166.225.170:60808->145.79.227.45:4237: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968277563 (80h18m27.664126306s) [seg_pos={0 0}, upload=70665]: Done waiting for segment. successful: 5 optimal: 14 errs: <nil> Nov 2 19:58:56.213414304 (80h18m27.909263047s) [upload=70665]: Done uploading segments... Nov 2 19:58:56.213452137 (80h18m27.90930088s) [upload=70665]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 5) Duration: 5.708809667s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.700764094s trace: https://jaeger.dev.storj.io/trace/6469a32319fb23c3 FAIL (2025-11-02 19:59:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 5) ======LOGS====== _id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.939448529 (80h17m28.635297282s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940316662 (80h17m28.636165416s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940854095 (80h17m28.636702838s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941163254 (80h17m28.637011997s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941597421 (80h17m28.637446175s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.944379569 (80h17m28.640228322s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945350588 (80h17m28.641199341s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945999965 (80h17m28.641848708s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.946799317 (80h17m28.64264806s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949026458 (80h17m28.644875211s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949648072 (80h17m28.645496815s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:58.374326863 (80h17m30.070175616s) [upload=70665]: Next returned nil segment Nov 2 19:57:58.374346910 (80h17m30.070195674s) [upload=70665]: Waiting for error group managing segments... Nov 2 19:57:58.737256438 (80h17m30.433105181s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.932997019 (80h17m30.628845773s) [noise=true , address=45.91.116.8:4046 , piece_id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.948107422 (80h17m30.643956175s) [noise=true , address=77.90.31.19:4861 , piece_id=DPE7KWFAPMTW67GEMLT2YCBXVMLY75BAU7BLRRYN2UBDIWHUZNJQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.005265203 (80h17m30.701113946s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.052320256 (80h17m30.748169009s) [noise=true , address=77.90.31.13:4658 , piece_id=ZTX6WQ5M3TTA7KUKMJVKWHQHLMRMJW5EUUFVBRBQZDVBFZWWKZQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:58:55.966307021 (80h18m27.662155784s) [noise=true , address=145.79.227.3:4169 , piece_id=GCSPGUWUFDXU2TZ6BNUAEU75A4RUKYCRERUPQRD326RXSDAX7ATQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX, address:145.79.227.3:4169): protocol: rpc: dial tcp 145.79.227.3:4169: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966419525 (80h18m27.662268268s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K, address:145.79.227.13:4833): protocol: rpc: dial tcp 145.79.227.13:4833: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966726459 (80h18m27.662575212s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1MGCEjVE57ej5VuXgC6pYPFNUuAL851p2gqC53xxj6hEXvgYM5, address:145.79.227.18:4030): protocol: rpc: dial tcp 145.79.227.18:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966930668 (80h18m27.662779421s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1F5oTP56RsDAA7Yde8hYvq7Lx5tiFDUHoBvPrYnhQiFy2Rko3N, address:145.79.227.38:4995): protocol: read tcp 188.166.225.170:59394->145.79.227.38:4995: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967260457 (80h18m27.66310921s) [noise=true , address=145.79.227.41:4097 , piece_id=ANQYF4KYYUUGFNUOHEINXGP2VQATR2LNVY6L55FA5FOL5HNAJRGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1sMhTktqf2H4aZSyFV3m9Z6eMVxL2U52bvUHVHUh2gUCVp32AM, address:145.79.227.41:4097): protocol: rpc: dial tcp 145.79.227.41:4097: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967696617 (80h18m27.66354536s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX, address:145.79.227.48:4310): protocol: rpc: dial tcp 145.79.227.48:4310: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967744338 (80h18m27.663593081s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9, address:145.79.227.8:4357): protocol: rpc: dial tcp 145.79.227.8:4357: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967941153 (80h18m27.663789906s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72, address:145.79.227.49:4346): protocol: read tcp 188.166.225.170:47702->145.79.227.49:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967952104 (80h18m27.663800847s) [noise=true , address=145.79.227.5:4242 , piece_id=54VY4XFFRB3G5P7VLHFAFUJQTVHVIEHKK2TZT4PNQUOUIFME7MFA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz, address:145.79.227.5:4242): protocol: rpc: dial tcp 145.79.227.5:4242: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968005255 (80h18m27.663854008s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:126wqKRVvj3engw69RJSmdgdB91qMyG1Ed5XfUCpu3ZGq3uXSbe, address:145.79.227.37:4587): protocol: rpc: dial tcp 145.79.227.37:4587: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968119682 (80h18m27.663968426s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1kgUqvw1r3gSKw1bNjzys3AiAJXdkAnSafmvcPgNVPBbN9JS1d, address:145.79.227.46:4602): protocol: read tcp 188.166.225.170:54484->145.79.227.46:4602: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968176942 (80h18m27.664025695s) [noise=true , address=145.79.227.43:4180 , piece_id=62QSVFJI44O5UMXM7SBZXY7SRMH6ZYSDD23OKDX5WXRLQCYNSXTQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1rhkcipPBZNFScBjBhWdigzSMwENSmzhCucnC2iuyc9udpweE3, address:145.79.227.43:4180): protocol: read tcp 188.166.225.170:48566->145.79.227.43:4180: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968252796 (80h18m27.664101549s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1VzewCRbNpJv7kNwp9wruQuoVSaZFjA44qN33Ct7qm1GnfhtDj, address:145.79.227.45:4237): protocol: read tcp 188.166.225.170:60808->145.79.227.45:4237: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968277563 (80h18m27.664126306s) [seg_pos={0 0}, upload=70665]: Done waiting for segment. successful: 5 optimal: 14 errs: <nil> Nov 2 19:58:56.213414304 (80h18m27.909263047s) [upload=70665]: Done uploading segments... Nov 2 19:58:56.213452137 (80h18m27.90930088s) [upload=70665]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 5) Duration: 5.700780956s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.249365104s trace: https://jaeger.dev.storj.io/trace/6469a32319fb23c3 FAIL (2025-11-02 19:58:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 5) ======LOGS====== _id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.939448529 (80h17m28.635297282s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940316662 (80h17m28.636165416s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.940854095 (80h17m28.636702838s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941163254 (80h17m28.637011997s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.941597421 (80h17m28.637446175s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.944379569 (80h17m28.640228322s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945350588 (80h17m28.641199341s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.945999965 (80h17m28.641848708s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.946799317 (80h17m28.64264806s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949026458 (80h17m28.644875211s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:56.949648072 (80h17m28.645496815s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Uploading piece... Nov 2 19:57:58.374326863 (80h17m30.070175616s) [upload=70665]: Next returned nil segment Nov 2 19:57:58.374346910 (80h17m30.070195674s) [upload=70665]: Waiting for error group managing segments... Nov 2 19:57:58.737256438 (80h17m30.433105181s) [noise=true , address=64.49.13.169:4715 , piece_id=MSNF6WCWWVJEM5X5FDCH5OFWJENAIQQ6FBY63GGC3NG7HYR66X6A, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.932997019 (80h17m30.628845773s) [noise=true , address=45.91.116.8:4046 , piece_id=USBTO6WYEAFPBP3NY7PKZZWDDPLI2QBWX33ZHTJVX6XWBGGWKXWA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:58.948107422 (80h17m30.643956175s) [noise=true , address=77.90.31.19:4861 , piece_id=DPE7KWFAPMTW67GEMLT2YCBXVMLY75BAU7BLRRYN2UBDIWHUZNJQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.005265203 (80h17m30.701113946s) [noise=true , address=77.90.31.11:4571 , piece_id=Z6UVBULYAS4O4FUHFRFGZ3YD2D24BMAJFZABU6HCDG2GHXZF6TWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:57:59.052320256 (80h17m30.748169009s) [noise=true , address=77.90.31.13:4658 , piece_id=ZTX6WQ5M3TTA7KUKMJVKWHQHLMRMJW5EUUFVBRBQZDVBFZWWKZQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: <nil> Nov 2 19:58:55.966307021 (80h18m27.662155784s) [noise=true , address=145.79.227.3:4169 , piece_id=GCSPGUWUFDXU2TZ6BNUAEU75A4RUKYCRERUPQRD326RXSDAX7ATQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX, address:145.79.227.3:4169): protocol: rpc: dial tcp 145.79.227.3:4169: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966419525 (80h18m27.662268268s) [noise=true , address=145.79.227.13:4833 , piece_id=V62DR4BLHZXAO6H2AYYEQ2L42TKBRCRD5ECU32RRVNTEKTJPTPWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K, address:145.79.227.13:4833): protocol: rpc: dial tcp 145.79.227.13:4833: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966726459 (80h18m27.662575212s) [noise=true , address=145.79.227.18:4030 , piece_id=OMSVZ6FODSRR3BBORZ7DSFFE7AYSSIUEIUOO4KMCXYOE2FM6DPGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1MGCEjVE57ej5VuXgC6pYPFNUuAL851p2gqC53xxj6hEXvgYM5, address:145.79.227.18:4030): protocol: rpc: dial tcp 145.79.227.18:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.966930668 (80h18m27.662779421s) [noise=true , address=145.79.227.38:4995 , piece_id=27YBF4I34SVRPINHA53UNKNCHIQVRUH7C4E2SIJIXEAVXCBWYV6Q, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1F5oTP56RsDAA7Yde8hYvq7Lx5tiFDUHoBvPrYnhQiFy2Rko3N, address:145.79.227.38:4995): protocol: read tcp 188.166.225.170:59394->145.79.227.38:4995: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967260457 (80h18m27.66310921s) [noise=true , address=145.79.227.41:4097 , piece_id=ANQYF4KYYUUGFNUOHEINXGP2VQATR2LNVY6L55FA5FOL5HNAJRGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1sMhTktqf2H4aZSyFV3m9Z6eMVxL2U52bvUHVHUh2gUCVp32AM, address:145.79.227.41:4097): protocol: rpc: dial tcp 145.79.227.41:4097: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967696617 (80h18m27.66354536s) [noise=true , address=145.79.227.48:4310 , piece_id=QL3QV64VFPDFTM525S6Q5MPBHYRJ5ASE56GQLB3425X6VT5S7NQA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX, address:145.79.227.48:4310): protocol: rpc: dial tcp 145.79.227.48:4310: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967744338 (80h18m27.663593081s) [noise=true , address=145.79.227.8:4357 , piece_id=FZDQG5JYXGRHS4QPMXBHZCOC5TRAC6TUEGN5W3XM2ICCNGZIPBDA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9, address:145.79.227.8:4357): protocol: rpc: dial tcp 145.79.227.8:4357: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967941153 (80h18m27.663789906s) [noise=true , address=145.79.227.49:4346 , piece_id=3VOF5UY4UZZ2F3YKWLQZAMPROUQHDZZGEMERLV2CPXH6M3ITCMJA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72, address:145.79.227.49:4346): protocol: read tcp 188.166.225.170:47702->145.79.227.49:4346: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.967952104 (80h18m27.663800847s) [noise=true , address=145.79.227.5:4242 , piece_id=54VY4XFFRB3G5P7VLHFAFUJQTVHVIEHKK2TZT4PNQUOUIFME7MFA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz, address:145.79.227.5:4242): protocol: rpc: dial tcp 145.79.227.5:4242: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968005255 (80h18m27.663854008s) [noise=true , address=145.79.227.37:4587 , piece_id=OI6L5A2N5RIWHFOVROUJLJXWIRILCPRL6DCOK5KBJE57RUTZFICQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:126wqKRVvj3engw69RJSmdgdB91qMyG1Ed5XfUCpu3ZGq3uXSbe, address:145.79.227.37:4587): protocol: rpc: dial tcp 145.79.227.37:4587: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968119682 (80h18m27.663968426s) [noise=true , address=145.79.227.46:4602 , piece_id=SVDV3T5Y57JACYZWRIX7AMSE3OVXDXNZEXE5LDY47PFUWOKOCRWQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1kgUqvw1r3gSKw1bNjzys3AiAJXdkAnSafmvcPgNVPBbN9JS1d, address:145.79.227.46:4602): protocol: read tcp 188.166.225.170:54484->145.79.227.46:4602: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968176942 (80h18m27.664025695s) [noise=true , address=145.79.227.43:4180 , piece_id=62QSVFJI44O5UMXM7SBZXY7SRMH6ZYSDD23OKDX5WXRLQCYNSXTQ, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1rhkcipPBZNFScBjBhWdigzSMwENSmzhCucnC2iuyc9udpweE3, address:145.79.227.43:4180): protocol: read tcp 188.166.225.170:48566->145.79.227.43:4180: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968252796 (80h18m27.664101549s) [noise=true , address=145.79.227.45:4237 , piece_id=4IFOBDAZWXHENJ4ZYTBC2RFFZ74ZI4QXWEL3SQS655NE2M3JXHGA, seg_pos={0 0}, upload=70665]: Done uploading piece. err: ecclient: upload failed (node:1VzewCRbNpJv7kNwp9wruQuoVSaZFjA44qN33Ct7qm1GnfhtDj, address:145.79.227.45:4237): protocol: read tcp 188.166.225.170:60808->145.79.227.45:4237: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 2 19:58:55.968277563 (80h18m27.664126306s) [seg_pos={0 0}, upload=70665]: Done waiting for segment. successful: 5 optimal: 14 errs: <nil> Nov 2 19:58:56.213414304 (80h18m27.909263047s) [upload=70665]: Done uploading segments... Nov 2 19:58:56.213452137 (80h18m27.90930088s) [upload=70665]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 5) Duration: 1m0.249392905s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................................XX] duration: 5.001404815s trace: https://jaeger.dev.storj.io/trace/1a875a21fbc9493b FAIL (2025-11-02 19:58:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00142886s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001767928s trace: https://jaeger.dev.storj.io/trace/55904bdfe45acbbd FAIL (2025-11-02 19:57:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001783287s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 44.084526ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:56:07 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 44.115185ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 301.856007ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:56:03 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 301.887759ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 378.144758ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:55:35 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 378.161451ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 51.240503ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:55:13 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 51.346043ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 325.880445ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:55:08 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 325.90876ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 310.263978ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:54:17 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 310.305217ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 358.876096ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:54:15 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 358.899669ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [X...X..........] duration: 605.557903ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:53:33 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 605.596327ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 344.387388ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:53:07 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 344.417154ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [.X...X.........] duration: 316.747244ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:52:51 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 316.778173ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 58.597192ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:52:23 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 58.623451ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [..X...X........] duration: 295.415845ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:52:07 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 295.458236ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [...X...X.......] duration: 344.953627ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:51:48 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 344.984204ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 56.045313ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:51:19 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 56.072804ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [....X...X......] duration: 302.908836ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:50:53 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 302.939796ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 62.917978ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:50:30 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 62.949067ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [.....X...X.....] duration: 312.46917ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:49:59 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 312.500369ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [......X...X....] duration: 326.934493ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:49:30 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 326.963638ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 49.794438ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:49:20 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 49.81586ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [.......X...X...] duration: 526.643674ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:48:58 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 526.673731ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 43.098418ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:48:32 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 43.12549ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [........X...X..] duration: 314.482703ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:48:25 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 314.514323ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 53.955804ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:48:04 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 53.978437ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 53.30306ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:47:45 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 53.330603ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 61.776626ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:47:28 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 61.804959ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [.........X...X.] duration: 311.27754ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:47:10 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 311.30938ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 44.234302ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:46:31 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 44.260862ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [..........X...X] duration: 224.99011ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/36bad4850ad9386 FAIL (2025-11-02 19:46:20 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55866->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 225.016971ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 74.315312ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:46:11 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 74.358915ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 302.352383ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/4ad19944aa40673e FAIL (2025-11-02 19:45:42 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55952->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 302.372852ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 221.443437ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/11c320f6e480120c FAIL (2025-11-02 19:45:35 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:54156->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 221.466932ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 320.618306ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/4ad19944aa40673e FAIL (2025-11-02 19:45:04 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55952->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 320.648544ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 325.088289ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/4ad19944aa40673e FAIL (2025-11-02 19:44:44 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55952->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 325.112236ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 229.258538ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/4ad19944aa40673e FAIL (2025-11-02 19:43:39 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:55952->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 229.28091ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 56.141807ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c597b41138c2b48 FAIL (2025-11-02 19:36:29 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:45346->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 56.162837ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 58.785161ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c597b41138c2b48 FAIL (2025-11-02 19:36:00 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:45346->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 58.822481ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 45.582119ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c597b41138c2b48 FAIL (2025-11-02 19:35:10 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:45346->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 45.605603ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 68.70502ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c597b41138c2b48 FAIL (2025-11-02 19:34:03 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:45346->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 68.734727ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 58.103072ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c597b41138c2b48 FAIL (2025-11-02 19:33:33 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:45346->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 58.122198ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 49.807655ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c597b41138c2b48 FAIL (2025-11-02 19:32:33 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:45346->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 49.832332ms core website

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)