Orbiter History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 4 out of 60 is failed (threshold=3) [.................................................X..X..X..X.] duration: 6.2614037s FAIL (2025-09-06 09:36:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 6.261421323s edge authservice http us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................................X..X....X.X.....] duration: 5.65176923s FAIL (2025-09-06 09:36:17 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47) Duration: 5.651787465s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration: 30.001339306s FAIL (2025-09-06 09:36:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001357481s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration: 31.476272689s FAIL (2025-09-06 09:36:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== piece_id=BSCU2LGGWUTSGUY626MOHDNSWU7F2WCZWGIAUOEULB2F6G5EPY3A, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:35:52.386757455 (187h27m49.066953024s) [noise=true , address=45.91.116.9:4263 , piece_id=VZUW7Q3IXR2VOIME46MHVTY22IXUAO6HG3GQSRUVXD6H6CX7FCFQ, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:35:52.386775709 (187h27m49.066971278s) [noise=true , address=77.90.31.10:4520 , piece_id=22W25RT2J2AQCJ3IK5LSHVDLZQ6OGJD3ETQDARV364P4PWV67MCA, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:35:52.386973417 (187h27m49.067168986s) [noise=true , address=45.91.116.10:4081 , piece_id=CJKJI2VMOORW7FVAOQSTCSBYNMSAD3XVCEWMGHI5HOKZJ3KT2X6A, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:35:52.387049032 (187h27m49.067244601s) [noise=true , address=77.90.31.12:4589 , piece_id=MKBIOXAGL6FGGBLIXYQLYAKL2ARTSBYUONKP7OXAAXLX6FCB7OOQ, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:35:52.387190032 (187h27m49.067385601s) [noise=true , address=77.90.31.10:4519 , piece_id=GVGY2HNU74MHKFGZQI7DJVSLZALFURJ52UZQYRG2JL5UVOKZ3Y5Q, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:35:52.387299661 (187h27m49.067495231s) [noise=true , address=45.91.116.12:4225 , piece_id=MFNZJLNAUYQYZS465KHLOVM7T654ADR7BFSJT76M6IWZ32GLP4TQ, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:35:52.387572083 (187h27m49.067767652s) [noise=true , address=77.90.31.16:4735 , piece_id=IQLGRLUSFYTLFBP626RF7LBYFBC26AIV45MNZ4VIFUEWSILYVVSA, seg_pos={0 0}, upload=164963]: Uploading piece... Sep 6 09:36:14.100490752 (187h28m10.780686351s) [upload=164963]: Next segment err: context deadline exceeded Sep 6 09:36:14.101225107 (187h28m10.781420667s) [noise=true , address=45.91.116.12:4225 , piece_id=MFNZJLNAUYQYZS465KHLOVM7T654ADR7BFSJT76M6IWZ32GLP4TQ, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 188.166.225.170:52172->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:52172->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52172->45.91.116.12:4225: use of closed network connection Sep 6 09:36:14.101457423 (187h28m10.781652992s) [noise=true , address=77.90.31.12:4592 , piece_id=U36IGGVSHOHSLSORQMWBRHDOZIY24DW6U3M3RQED3CXRG6LMRAJQ, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:41148->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:41148->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41148->77.90.31.12:4592: use of closed network connection Sep 6 09:36:14.101491628 (187h28m10.781687197s) [noise=true , address=77.90.31.10:4519 , piece_id=GVGY2HNU74MHKFGZQI7DJVSLZALFURJ52UZQYRG2JL5UVOKZ3Y5Q, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.101551051 (187h28m10.78174663s) [noise=true , address=45.91.116.11:4118 , piece_id=5C26SOPKJ5AACXDEWU4UCMNRMBMETWTU3O574DRUFW5KOIGQCJKA, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 188.166.225.170:56428->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.101612088 (187h28m10.781807657s) [noise=true , address=77.90.31.10:4520 , piece_id=22W25RT2J2AQCJ3IK5LSHVDLZQ6OGJD3ETQDARV364P4PWV67MCA, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 188.166.225.170:34956->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.101635623 (187h28m10.781831192s) [noise=true , address=45.91.116.4:4938 , piece_id=532GRUHFRDGHHS2IMN4JBZH4YKSWCN3J44FRXULZMTVD3HOZ4RGA, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:48638->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.101654349 (187h28m10.781862301s) [noise=true , address=45.91.116.7:4009 , piece_id=Q554LEZLETZPPEKDTPGZEH3Q52DVXKGED2EL4NWQH5C6WX2MX6DA, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 188.166.225.170:36210->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.101709505 (187h28m10.781905074s) [noise=true , address=77.90.31.19:4842 , piece_id=L2RRTNKPFMLMUWR4C7F6QF2DZMMRNREGFVJK76A7T3MXTXJDZGSQ, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56824->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.101888246 (187h28m10.782083815s) [noise=true , address=45.91.116.9:4263 , piece_id=VZUW7Q3IXR2VOIME46MHVTY22IXUAO6HG3GQSRUVXD6H6CX7FCFQ, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:37486->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:37486->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37486->45.91.116.9:4263: use of closed network connection Sep 6 09:36:14.101931059 (187h28m10.782126628s) [noise=true , address=77.90.31.21:4877 , piece_id=BSCU2LGGWUTSGUY626MOHDNSWU7F2WCZWGIAUOEULB2F6G5EPY3A, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 188.166.225.170:55774->77.90.31.21:4877: use of closed network connection; write tcp 188.166.225.170:55774->77.90.31.21:4877: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55774->77.90.31.21:4877: use of closed network connection Sep 6 09:36:14.101953061 (187h28m10.78214863s) [noise=true , address=45.91.116.10:4081 , piece_id=CJKJI2VMOORW7FVAOQSTCSBYNMSAD3XVCEWMGHI5HOKZJ3KT2X6A, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: rpc: dial tcp 45.91.116.10:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.102004720 (187h28m10.782200289s) [noise=true , address=77.90.31.13:4626 , piece_id=VVQ7RNGYJGF74N5EQIJOGNYJK65T26XDU7VBBZIR6IAOJSVBVBLQ, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: read tcp 188.166.225.170:42654->77.90.31.13:4626: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.102037472 (187h28m10.782233041s) [noise=true , address=77.90.31.16:4735 , piece_id=IQLGRLUSFYTLFBP626RF7LBYFBC26AIV45MNZ4VIFUEWSILYVVSA, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 188.166.225.170:45890->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.102091195 (187h28m10.782286764s) [noise=true , address=77.90.31.21:4878 , piece_id=7DLYG2SDVW7RTAYEWAXB7CJ6HJ43M26GR6VMVZJL2VVVBC434L6Q, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 188.166.225.170:37356->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.102101555 (187h28m10.782297124s) [noise=true , address=45.91.116.11:4117 , piece_id=BF5NEAJ4WTBKKFPU2UCMTOYXKCPHUFT3ZZGLSJW37SKUIJL3BRUA, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:40194->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.102128105 (187h28m10.782323674s) [noise=true , address=77.90.31.12:4589 , piece_id=MKBIOXAGL6FGGBLIXYQLYAKL2ARTSBYUONKP7OXAAXLX6FCB7OOQ, seg_pos={0 0}, upload=164963]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 188.166.225.170:52690->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:14.102213869 (187h28m10.782409438s) [seg_pos={0 0}, upload=164963]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 31.47629477s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 4 out of 60 is failed (threshold=3) [..................................................X..X..X..X] duration: 2m0.001017758s FAIL (2025-09-06 09:36:14 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2m0.001041894s edge authservice http us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 3.560368814s FAIL (2025-09-06 09:36:12 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 3.560392288s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration: 1m0.173862123s FAIL (2025-09-06 09:36:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 7) ======LOGS====== ion; write tcp 188.166.225.170:35724->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35724->185.167.204.205:4027: use of closed network connection Sep 6 09:36:06.160529852 (187h28m2.840725421s) [noise=true , address=185.167.204.205:4036 , piece_id=2TWAZWKPZERCRMV2EDH6PESTNOFXB2IQ2EFV5ZP7FAZ5KNXHTKVA, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 188.166.225.170:40962->185.167.204.205:4036: use of closed network connection; write tcp 188.166.225.170:40962->185.167.204.205:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40962->185.167.204.205:4036: use of closed network connection Sep 6 09:36:06.160575189 (187h28m2.840770758s) [noise=true , address=185.167.204.206:4062 , piece_id=5YMU7RY4GCDEIS4226N5HUM7VDOHYV4C7NJBFYWDFENZSDSYHCFQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 188.166.225.170:34276->185.167.204.206:4062: use of closed network connection; write tcp 188.166.225.170:34276->185.167.204.206:4062: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34276->185.167.204.206:4062: use of closed network connection Sep 6 09:36:06.160617941 (187h28m2.84081351s) [noise=true , address=185.167.204.205:4022 , piece_id=SN2OM4N3L7O4T3SUDYJTPT4D7M6Q4LZGOLIUVQDGFYVF5FSA3XRQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj, address:185.167.204.205:4022): protocol: write tcp 188.166.225.170:54608->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:54608->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54608->185.167.204.205:4022: use of closed network connection Sep 6 09:36:06.160659361 (187h28m2.84085493s) [noise=true , address=185.167.204.206:4053 , piece_id=CWW7WQXEDZRYWGXALJDLXAFLK2AYTHQHNYEHFMPZRRTZKZ3QPCJA, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: write tcp 188.166.225.170:51956->185.167.204.206:4053: use of closed network connection; write tcp 188.166.225.170:51956->185.167.204.206:4053: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51956->185.167.204.206:4053: use of closed network connection Sep 6 09:36:06.160701891 (187h28m2.84089746s) [noise=true , address=81.171.14.70:4030 , piece_id=ZYN2MCYZVDUJFNSOGKGQJRJMZ6IKCRWANJCTRGXH7T4WSGVDUM7Q, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:51878->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:51878->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51878->81.171.14.70:4030: use of closed network connection Sep 6 09:36:06.160742620 (187h28m2.840938189s) [noise=true , address=185.167.204.205:4026 , piece_id=KW7IVY4VKXY4IWFRBLFL4HNZIV5J6FDSP44R6ERGUNQQP7CKIN3Q, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: write tcp 188.166.225.170:54764->185.167.204.205:4026: use of closed network connection; write tcp 188.166.225.170:54764->185.167.204.205:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54764->185.167.204.205:4026: use of closed network connection Sep 6 09:36:06.160747810 (187h28m2.840943379s) [noise=true , address=185.167.204.205:4034 , piece_id=3N6TMAMFENC2XY44DR7QIKVQCMQ7NE3PVQ37SE3SBJXPLO4XOEYQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:40224->185.167.204.205:4034: use of closed network connection; write tcp 188.166.225.170:40224->185.167.204.205:4034: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40224->185.167.204.205:4034: use of closed network connection Sep 6 09:36:06.160784730 (187h28m2.840980299s) [noise=true , address=185.167.204.205:4009 , piece_id=IJUCVPFQVQOMVPLYUKZQOS6BD22OVAUSI22EIJHGDF3UJSLITGOA, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:39946->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:39946->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39946->185.167.204.205:4009: use of closed network connection Sep 6 09:36:06.160789489 (187h28m2.840985058s) [noise=true , address=185.167.204.206:4069 , piece_id=DFIT3EUCYO3JCGZV72H3JMLU2WZKAN2GBBBPGQFCFSJC6RATW47A, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 188.166.225.170:43554->185.167.204.206:4069: use of closed network connection; write tcp 188.166.225.170:43554->185.167.204.206:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43554->185.167.204.206:4069: use of closed network connection Sep 6 09:36:06.160823955 (187h28m2.841019524s) [noise=true , address=81.171.14.70:4026 , piece_id=WCVE4WTN5SA4TLEQJUVGQ3Y6PDKPRN26GOVD437TADIZ4XFDTWAA, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:54724->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:54724->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54724->81.171.14.70:4026: use of closed network connection Sep 6 09:36:06.160832231 (187h28m2.8410278s) [noise=true , address=81.171.14.70:4046 , piece_id=WV7VGGHI23A2MRLOTH2A5GE47ULARV2HXQCP4R4DTFSTSZ36EVZA, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:32792->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:32792->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32792->81.171.14.70:4046: use of closed network connection Sep 6 09:36:06.160861076 (187h28m2.841056645s) [noise=true , address=185.167.204.206:4066 , piece_id=CF46IB3XVLBJCSDSO3WWIAYZBBTBALRTCW7Q3VJJ2HOZJNZHHCDQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 188.166.225.170:46536->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:06.160870664 (187h28m2.841066233s) [noise=true , address=81.171.14.70:4032 , piece_id=ICFLKN7MRKLQM5HHD6FDZXPFJIJ44OY4Z4ZY7PSHGC6F2UZ3TULQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:54534->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:54534->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54534->81.171.14.70:4032: use of closed network connection Sep 6 09:36:06.160908247 (187h28m2.841103816s) [noise=true , address=185.167.204.205:4006 , piece_id=H6WNAQMRXOHZOEUKZ4QMNHGNMK7ZISD5VPCF77TWN76YXHXPXWUQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: read tcp 188.166.225.170:46884->185.167.204.205:4006: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:06.160928705 (187h28m2.841124264s) [noise=true , address=185.167.204.206:4045 , piece_id=MGLM6PYG2UKRL7LUCOY5YTLR4VM74XIAR6UGXBOPMR6VITLX7TJQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:1JPbi9CNAvezq91fdgjboVcgrdwwN48dFfLXzzgXtJ9B5eEoYq, address:185.167.204.206:4045): protocol: read tcp 188.166.225.170:45802->185.167.204.206:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:06.160995023 (187h28m2.841190592s) [noise=true , address=185.167.204.205:4010 , piece_id=FNGCACGUYRNT3KZLGTZXUVTOOPLB44CJFTWG5JPI62UMTEJMYHLQ, seg_pos={0 0}, upload=164953]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: context deadline exceeded; context deadline exceeded Sep 6 09:36:06.161010131 (187h28m2.8412057s) [seg_pos={0 0}, upload=164953]: Done waiting for segment. successful: 7 optimal: 26 errs: <nil> Sep 6 09:36:06.332620674 (187h28m3.012816243s) [upload=164953]: Done uploading segments... Sep 6 09:36:06.332647576 (187h28m3.012843145s) [upload=164953]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 7) Duration: 1m0.17388717s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration: 1m0.00087212s FAIL (2025-09-06 09:36:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.00088253s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 30.000431799s FAIL (2025-09-06 09:36:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.000456697s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 1m0.457131117s FAIL (2025-09-06 09:36:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== ne exceeded Sep 6 09:36:01.149507465 (187h27m57.829703034s) [noise=true , address=145.79.227.52:4454 , piece_id=DKKSLW6AYEPML4E7FH4DCUUF5U5ZKSSJB72IETOPAU4RYGZUJPIA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2, address:145.79.227.52:4454): protocol: write tcp 188.166.225.170:51758->145.79.227.52:4454: use of closed network connection; write tcp 188.166.225.170:51758->145.79.227.52:4454: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51758->145.79.227.52:4454: use of closed network connection Sep 6 09:36:01.149623507 (187h27m57.829819076s) [noise=true , address=145.79.227.37:4593 , piece_id=J2RUI5EYCRVHA5ATZBLXJOODLZZPYKIQANPVKTBF3KJNHUKALNEA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:1x5LG8zU8YHJWXdU5ivVsVo7B3esnr816FxoHXDee1jGfFJsMS, address:145.79.227.37:4593): protocol: write tcp 188.166.225.170:53432->145.79.227.37:4593: use of closed network connection; write tcp 188.166.225.170:53432->145.79.227.37:4593: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53432->145.79.227.37:4593: use of closed network connection Sep 6 09:36:01.149787020 (187h27m57.829982589s) [noise=true , address=145.79.227.44:4198 , piece_id=UGDNLTCPUFI6BC67R5PBCNN56VNBKVALU2PS2HFCOVM3P2CH2FGA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: write tcp 188.166.225.170:43506->145.79.227.44:4198: use of closed network connection; write tcp 188.166.225.170:43506->145.79.227.44:4198: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43506->145.79.227.44:4198: use of closed network connection Sep 6 09:36:01.150030125 (187h27m57.830225694s) [noise=true , address=145.79.227.49:4359 , piece_id=SQJSCM4AYE7LAK6RB4PNCSZFEKDSIQV36M234TMHO6XKK6YRP3GQ, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:1YgFc7P9RCbYw9u2wfow8Z3DMwFvJ6AnCsvzoxU9pTwPWGw8MV, address:145.79.227.49:4359): protocol: write tcp 188.166.225.170:42810->145.79.227.49:4359: use of closed network connection; write tcp 188.166.225.170:42810->145.79.227.49:4359: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42810->145.79.227.49:4359: use of closed network connection Sep 6 09:36:01.150070763 (187h27m57.830266332s) [noise=true , address=145.79.227.45:4245 , piece_id=FFG4DYL74ZXKDHDAX7ZSY2DA7DEDHPXB4VC5LOJUS3FRY525GNQQ, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12YnxyH9TZVuVheQpH9NVRfFUeWHJEtV97wyEJafhCzGZSv13Fn, address:145.79.227.45:4245): protocol: write tcp 188.166.225.170:39698->145.79.227.45:4245: use of closed network connection; write tcp 188.166.225.170:39698->145.79.227.45:4245: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39698->145.79.227.45:4245: use of closed network connection Sep 6 09:36:01.150223685 (187h27m57.830419254s) [noise=true , address=145.79.227.5:4234 , piece_id=DGAUDG4ARCRXEHLBOGZWAXRDH5FUGUJOXNM6BSHUKHHKYXAPR7GQ, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12DtCsEnAhXZnGRXjnhNfqNz4RvPnvTMDz1ur7DyZiQtQ7nbwDS, address:145.79.227.5:4234): protocol: read tcp 188.166.225.170:38424->145.79.227.5:4234: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150258882 (187h27m57.830454451s) [noise=true , address=145.79.227.18:4013 , piece_id=C7C2DGCEYUYHOU2NZHIJ6XFGWMRTVET27HPFNH3E6WB3U6TJIULA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:127jXtnz4wJDoxR5x8ebMqRt94RvbxMZm4YzzZrabbVohZpF8eW, address:145.79.227.18:4013): protocol: read tcp 188.166.225.170:39494->145.79.227.18:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150292908 (187h27m57.830488477s) [noise=true , address=77.90.31.15:4732 , piece_id=RHIGNMJW3JDZW7PYF2UQO6ME7EKOBLDZLQFB7ZUQVCUDJO4OP4ZA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH, address:77.90.31.15:4732): protocol: read tcp 188.166.225.170:56096->77.90.31.15:4732: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150325310 (187h27m57.830520879s) [noise=true , address=77.90.31.17:4786 , piece_id=VNPHP726G5LYIDFBNBSRMUBJGU7N6Z5JBUA4CZHQC4DQUCXEG2YQ, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:128QrekLqpXLAJs7yqNziNLmt2i13SuMx1ZhMPdUpDosw71dgQh, address:77.90.31.17:4786): protocol: read tcp 188.166.225.170:33396->77.90.31.17:4786: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150358483 (187h27m57.830554052s) [noise=true , address=77.90.31.10:4532 , piece_id=OKMBZYOIIJ2W63G7VAI6VF73BAT55VZUUF453E37SZG4XQMWWL7A, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe, address:77.90.31.10:4532): protocol: read tcp 188.166.225.170:59454->77.90.31.10:4532: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150409561 (187h27m57.83060513s) [noise=true , address=145.79.227.43:4176 , piece_id=YKGYIAEQMPFCIYXM6GIX6IKHQYJIZD475Z6UBLGM6ACS3WWUFOHQ, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD, address:145.79.227.43:4176): protocol: write tcp 188.166.225.170:56704->145.79.227.43:4176: use of closed network connection; write tcp 188.166.225.170:56704->145.79.227.43:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56704->145.79.227.43:4176: use of closed network connection Sep 6 09:36:01.150452113 (187h27m57.830647682s) [noise=true , address=145.79.227.30:4787 , piece_id=XUKCE7ZPFSQNKWMBX25WJRSEVAP46DCZQEW2N2T4R5CUKWOXLK6A, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12aKqg1aNsv8Yi7fE4asGz8bijcPewWDvUukKcf5SFnzgARju43, address:145.79.227.30:4787): protocol: write tcp 188.166.225.170:41578->145.79.227.30:4787: use of closed network connection; write tcp 188.166.225.170:41578->145.79.227.30:4787: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41578->145.79.227.30:4787: use of closed network connection Sep 6 09:36:01.150477040 (187h27m57.830672609s) [noise=true , address=77.90.31.19:4846 , piece_id=J4I5OTHJLF7B7RSAC2KZXOLEDOC3K3ORMOBI6Z7ITTAXZ2OHWWSQ, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: read tcp 188.166.225.170:41862->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150534701 (187h27m57.83073027s) [noise=true , address=145.79.227.17:4997 , piece_id=74KGCORYNMGASKRWJRCMRZGC7TYHZDKXY24PSDG4ATSW265QNQLA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12UrPGB76X7LaXe3ioiu4NtUQ5FwspKYtBWD6rcMmZC6xbNnCAF, address:145.79.227.17:4997): protocol: read tcp 188.166.225.170:43458->145.79.227.17:4997: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150557263 (187h27m57.830752832s) [noise=true , address=145.79.227.14:4871 , piece_id=VGE24TW4237BCKNANDWHHBPAR5IJXQN4HPHC3X2SOZ3QTS6HZNHQ, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb, address:145.79.227.14:4871): protocol: write tcp 188.166.225.170:40716->145.79.227.14:4871: use of closed network connection; write tcp 188.166.225.170:40716->145.79.227.14:4871: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40716->145.79.227.14:4871: use of closed network connection Sep 6 09:36:01.150583544 (187h27m57.830779113s) [noise=true , address=45.91.116.7:4027 , piece_id=KPHRXFPPCHC5DKIZ7MJNZPFCZ4CI5G3GXXQ7QH5EQVPWUHPJ7YQA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12BQKHUMVYD7qDZW45LNEfgnkLVoSneDrQXViaMvcvAPdfmheMq, address:45.91.116.7:4027): protocol: read tcp 188.166.225.170:34316->45.91.116.7:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150602460 (187h27m57.830798029s) [noise=true , address=145.79.227.33:4872 , piece_id=JGWEWQXTKFOM2SGRW76W4LPKLIF3KZONUA2I4IGM2JUHLJUCXQBA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12dNdm2kAok8jFgbYE24oXUL9KCJVDDiinLUJgDSYEY3fTEBJec, address:145.79.227.33:4872): protocol: read tcp 188.166.225.170:35314->145.79.227.33:4872: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150624412 (187h27m57.830819981s) [noise=true , address=45.91.116.10:4094 , piece_id=TKSSCVNRZTCVGWCCUBF5TND4IOG2235CTMSN6ZHLBHTKSAN6I5GA, seg_pos={0 0}, upload=164958]: Done uploading piece. err: ecclient: upload failed (node:12R5csTJKhU4qSrzDL9vvhhosTu7BCYeEQigCtiVPaGLKEuJbmw, address:45.91.116.10:4094): protocol: read tcp 188.166.225.170:57020->45.91.116.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:36:01.150656033 (187h27m57.830851602s) [seg_pos={0 0}, upload=164958]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m0.457146967s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXX...X] duration: 30.001327059s FAIL (2025-09-06 09:35:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001347829s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 9 out of 60 is failed (threshold=3) [.............................................X.X.X.X.XX.XXX.] duration: 24.470868015s FAIL (2025-09-06 09:35:54 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 24.470886921s core uplink us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.928171621s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:35:53 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 2.928196018s edge linksharing us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 3.711861612s FAIL (2025-09-06 09:35:48 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 3.711890016s core uplink ap1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 5 out of 60 is failed (threshold=3) [..................................................XXX....X.X] duration: 1m0.848890315s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-09-06 09:35:46 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 1m0.84891408s core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................................X..X....X.X....] duration: 5.316286266s FAIL (2025-09-06 09:35:37 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47) Duration: 5.316311414s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 10 out of 60 is failed (threshold=3) [...........................................XXXXXX.....XXX.X.] duration: 14.785008573s FAIL (2025-09-06 09:35:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:34:54.550717667 (187h26m51.230913236s) [upload=164950]: Starting upload Sep 6 09:34:54.550769807 (187h26m51.230965366s) [upload=164950]: Done starting upload Sep 6 09:34:54.550814903 (187h26m51.231010472s) [upload=164950]: Uploading segments... Sep 6 09:34:54.550849440 (187h26m51.231045009s) [upload=164950]: Got next segment. Inline: true Sep 6 09:34:54.550852936 (187h26m51.231048495s) [upload=164950]: Waiting for error group managing segments... Sep 6 09:34:54.550881661 (187h26m51.23107723s) [upload=164950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:34:54.550885749 (187h26m51.231081318s) [upload=164950]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:34:54.550888334 (187h26m51.231083893s) [upload=164950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:35:13.314247508 (187h27m9.994443077s) [upload=164950]: Done uploading segments... Sep 6 09:35:13.314273307 (187h27m9.994468876s) [upload=164950]: Upload finished. err: metaclient: context deadline exceeded Duration:* 14.785023221s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration: 30.001330895s FAIL (2025-09-06 09:35:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001340745s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................................X..X....X.X...] duration: 6.432462356s FAIL (2025-09-06 09:35:17 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47) Duration: 6.432490609s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 32.396049346s FAIL (2025-09-06 09:35:16 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 39) Duration: 32.396064756s core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.27208019s FAIL (2025-09-06 09:35:16 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 4.272106091s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration: 30.434660563s FAIL (2025-09-06 09:35:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.921886219 (187h27m9.602081788s) [noise=true , address=45.91.116.11:4119 , piece_id=OVDLYOUN2RUJ6DZTJ3EO5WIQOT5IQGA572Z2IUXCJUPPV4EOFR2Q, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.922554226 (187h27m9.602749796s) [noise=true , address=45.91.116.6:4974 , piece_id=AB5YFWV6HL3JLCFLOM7LBGGK6AKCHWNTJ3AXIQWSO4GJIMXKS6HA, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.922932791 (187h27m9.60312835s) [noise=true , address=77.90.31.21:4878 , piece_id=K2BYOMBVEA7H2XQO4VJI24EK7GSS2K7VGDFTAMPZCV3577KUMB6Q, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.923063171 (187h27m9.60325874s) [noise=true , address=45.91.116.10:4083 , piece_id=F7GOV4HZNT6XCXFA74VQE6P7Y72ML7LSJHW4725XLHX5R2RCWYKQ, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.923319170 (187h27m9.603514739s) [noise=true , address=77.90.31.15:4699 , piece_id=VJTZXF2S3IU5P3O7QS35U5NI4LGPXFQLKWPN6KRSSP4WCFQF4KEA, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.923574009 (187h27m9.603769578s) [noise=true , address=45.91.116.10:4082 , piece_id=X5JRFSP7NOQECOOGWKPKMIRMG543HM5KRNTYT6BQNNND4BLV4BGQ, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.923908488 (187h27m9.604104057s) [noise=true , address=45.91.116.6:4975 , piece_id=UQ56UMVQ5D5RRXCEAATAFPU4EVWCFR4QY2KEZHODITF7J5JZWVJQ, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.924131505 (187h27m9.604327074s) [noise=true , address=45.91.116.14:4191 , piece_id=6RDBYUY6FGSPZR5RKD6IZTW6ZCAPDWFQ2EPYJ63Y6OHPWMFBFYKA, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.924345505 (187h27m9.604541074s) [noise=true , address=45.91.116.13:4153 , piece_id=KQOLTYWQCVZJA2GMXZA5LKX4SUTWLA6VAILLTMEOJRMV4NXAFTVQ, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:12.924544505 (187h27m9.604740074s) [noise=true , address=77.90.31.17:4770 , piece_id=PLMNR5ITE4EZVZPP2SUZSNNT7PPF5QN5RXHMRYQWYTSJ23H74VYA, seg_pos={0 0}, upload=164954]: Uploading piece... Sep 6 09:35:13.992911707 (187h27m10.673107277s) [upload=164954]: Next segment err: context deadline exceeded Sep 6 09:35:13.993539227 (187h27m10.673734796s) [noise=true , address=77.90.31.14:4663 , piece_id=YI5FUGDMJIZRCSDWBUU6GXNSFKOW4DOLBAAN6ZP42YZZM6VUU7ZA, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:36708->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.993597680 (187h27m10.673793249s) [noise=true , address=45.91.116.10:4083 , piece_id=F7GOV4HZNT6XCXFA74VQE6P7Y72ML7LSJHW4725XLHX5R2RCWYKQ, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:52364->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.993642034 (187h27m10.673837603s) [noise=true , address=45.91.116.11:4119 , piece_id=OVDLYOUN2RUJ6DZTJ3EO5WIQOT5IQGA572Z2IUXCJUPPV4EOFR2Q, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.993710987 (187h27m10.673906556s) [noise=true , address=45.91.116.4:4939 , piece_id=ZR7AWNU4IM2EKC3BG5P4YTY4FCYG2TZDNHEC7ZGS6ZYEY2WOHMFA, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: rpc: dial tcp 45.91.116.4:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.993843390 (187h27m10.674038959s) [noise=true , address=45.91.116.9:4261 , piece_id=HMH6OT4SY576IWSRR2LA44RUPYLCFIZXGXGUJEUEVV7CWJZCVEYA, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 188.166.225.170:59592->45.91.116.9:4261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.993884669 (187h27m10.674080238s) [noise=true , address=77.90.31.21:4878 , piece_id=K2BYOMBVEA7H2XQO4VJI24EK7GSS2K7VGDFTAMPZCV3577KUMB6Q, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 188.166.225.170:37158->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.993946016 (187h27m10.674141575s) [noise=true , address=45.91.116.6:4974 , piece_id=AB5YFWV6HL3JLCFLOM7LBGGK6AKCHWNTJ3AXIQWSO4GJIMXKS6HA, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:37864->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994022252 (187h27m10.674217811s) [noise=true , address=77.90.31.17:4770 , piece_id=PLMNR5ITE4EZVZPP2SUZSNNT7PPF5QN5RXHMRYQWYTSJ23H74VYA, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 188.166.225.170:36406->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994058382 (187h27m10.674253951s) [noise=true , address=77.90.31.15:4699 , piece_id=VJTZXF2S3IU5P3O7QS35U5NI4LGPXFQLKWPN6KRSSP4WCFQF4KEA, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: read tcp 188.166.225.170:55890->77.90.31.15:4699: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994097506 (187h27m10.674293075s) [noise=true , address=45.91.116.11:4117 , piece_id=ZRTEMJVWTIK7GTQN5I6UW55RZI5SXRQ4NI5YJUMBHRGSHFDYGN4Q, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 188.166.225.170:44412->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994108497 (187h27m10.674304056s) [noise=true , address=45.91.116.10:4082 , piece_id=X5JRFSP7NOQECOOGWKPKMIRMG543HM5KRNTYT6BQNNND4BLV4BGQ, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: read tcp 188.166.225.170:34838->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994135188 (187h27m10.674330757s) [noise=true , address=45.91.116.12:4226 , piece_id=LO65HUQ5YY23UVSDY4GZPQMZ5L45KENT6ZEMPF5N5WWUUHYLGT5A, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 188.166.225.170:60848->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994226824 (187h27m10.674422393s) [noise=true , address=77.90.31.14:4661 , piece_id=3C7H3MGLC22XHAWUHYUZPQLYG5QY2MFTTJDFES5VEGPXUWQLI3RQ, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 188.166.225.170:58128->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994257853 (187h27m10.674453422s) [noise=true , address=45.91.116.6:4975 , piece_id=UQ56UMVQ5D5RRXCEAATAFPU4EVWCFR4QY2KEZHODITF7J5JZWVJQ, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 188.166.225.170:47904->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994304262 (187h27m10.674499831s) [noise=true , address=45.91.116.13:4153 , piece_id=KQOLTYWQCVZJA2GMXZA5LKX4SUTWLA6VAILLTMEOJRMV4NXAFTVQ, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 188.166.225.170:40704->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994315734 (187h27m10.674511293s) [noise=true , address=45.91.116.14:4191 , piece_id=6RDBYUY6FGSPZR5RKD6IZTW6ZCAPDWFQ2EPYJ63Y6OHPWMFBFYKA, seg_pos={0 0}, upload=164954]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 188.166.225.170:58510->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:35:13.994335472 (187h27m10.674531041s) [seg_pos={0 0}, upload=164954]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.434672647s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 10 out of 60 is failed (threshold=3) [............................................XXXXXX.....XXX.X] duration: 30.000526923s FAIL (2025-09-06 09:35:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:34:54.550717667 (187h26m51.230913236s) [upload=164950]: Starting upload Sep 6 09:34:54.550769807 (187h26m51.230965366s) [upload=164950]: Done starting upload Sep 6 09:34:54.550814903 (187h26m51.231010472s) [upload=164950]: Uploading segments... Sep 6 09:34:54.550849440 (187h26m51.231045009s) [upload=164950]: Got next segment. Inline: true Sep 6 09:34:54.550852936 (187h26m51.231048495s) [upload=164950]: Waiting for error group managing segments... Sep 6 09:34:54.550881661 (187h26m51.23107723s) [upload=164950]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:34:54.550885749 (187h26m51.231081318s) [upload=164950]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:34:54.550888334 (187h26m51.231083893s) [upload=164950]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:35:13.314247508 (187h27m9.994443077s) [upload=164950]: Done uploading segments... Sep 6 09:35:13.314273307 (187h27m9.994468876s) [upload=164950]: Upload finished. err: metaclient: context deadline exceeded Duration:* 30.000549565s core uplink us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 16.151336696s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:35:11 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 16.151356966s edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXX...] duration: 18.725522993s FAIL (2025-09-06 09:35:08 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 18.725548853s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 1m0.0012848s FAIL (2025-09-06 09:35:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001298146s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration: 6.8283336s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:35:02 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 6.828374528s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 2m25.898762564s FAIL (2025-09-06 09:35:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== UPN45HBIEAAMVQQ7UPQ, seg_pos={0 0}, upload=164925]: Uploading piece... Sep 6 09:33:21.001028478 (187h25m17.681224047s) [noise=true , address=45.91.116.5:4322 , piece_id=G3QKLOHGV5IUFUYBUUFAABKAYXOZPJPKHKXXRIUL3Q3AC5HHRUOA, seg_pos={0 0}, upload=164925]: Uploading piece... Sep 6 09:33:21.001254761 (187h25m17.68145033s) [noise=true , address=77.90.31.10:4542 , piece_id=GE72J5KY43LGRTTISDG2VT4JQVUUMKWAJU637QQTMMR4IV2U5FDA, seg_pos={0 0}, upload=164925]: Uploading piece... Sep 6 09:33:21.001465544 (187h25m17.681661113s) [noise=true , address=145.79.227.49:4340 , piece_id=26PCT5WQTEMJ6LUIWY3KVZD5MMQ7L6W5MYCFYC4HFQWZXYYPCSCA, seg_pos={0 0}, upload=164925]: Uploading piece... Sep 6 09:33:21.001664896 (187h25m17.681860465s) [noise=true , address=145.79.227.33:4873 , piece_id=OMRSTBQNWOLLXJ643OSJMPFWYDRPZUNLZ3KXHQVMTY2JXDJKCLZQ, seg_pos={0 0}, upload=164925]: Uploading piece... Sep 6 09:33:21.001880759 (187h25m17.682076338s) [noise=true , address=145.79.227.30:4768 , piece_id=UA4EERV2JVYWIQ2Q4VXC63Q44AMORALYC5JNLITGKI4CHPW54KTA, seg_pos={0 0}, upload=164925]: Uploading piece... Sep 6 09:33:34.997505446 (187h25m31.677701015s) [upload=164925]: Next segment err: context deadline exceeded Sep 6 09:33:34.998307591 (187h25m31.67850316s) [noise=true , address=77.90.31.18:4840 , piece_id=2HJMQUERSC5B52RI4YECKPAXIPECJOZWDUPN45HBIEAAMVQQ7UPQ, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: rpc: dial tcp 77.90.31.18:4840: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998351245 (187h25m31.678546814s) [noise=true , address=145.79.227.35:4502 , piece_id=NGALHPVLDRNW6PLQKFXIZ2D56J7OH2CRQWCNMJDF2NQI62GMG64A, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12HP5xuRAGgTsL11UQh7VRgfuFzwNdEMXgc8zPVv4QknStyv6Ta, address:145.79.227.35:4502): protocol: rpc: dial tcp 145.79.227.35:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998447019 (187h25m31.678642588s) [noise=true , address=145.79.227.39:4017 , piece_id=5OQX5TDJHMXB366NJ2YTJHZMI7YO5SBWKTNX6HUKMXBNUFE7XHVA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12ocB4w2b2owjyWVCcq59Ymo2prJfSFmK5YogQDjGBroF11Tegk, address:145.79.227.39:4017): protocol: read tcp 188.166.225.170:53170->145.79.227.39:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998494379 (187h25m31.678689948s) [noise=true , address=45.91.116.9:4292 , piece_id=SOIKYYQNPJYJPVPTJMOCXSEJH7VNXTI42BJP7SJ3J23YBDHZNZNA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12tnWSKAebAwLeGWGRsNnYpcWgbX5UHSVRUnnu9qesUZCK4vY81, address:45.91.116.9:4292): protocol: read tcp 188.166.225.170:49716->45.91.116.9:4292: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998527702 (187h25m31.678723271s) [noise=true , address=145.79.227.2:4141 , piece_id=X3VDDTANBC644XMKKNNRNIBBR5J3TG3Q2G6OMOZLTT2HQQX2COHA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL, address:145.79.227.2:4141): protocol: read tcp 188.166.225.170:48146->145.79.227.2:4141: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998559614 (187h25m31.678755183s) [noise=true , address=145.79.227.5:4229 , piece_id=5FSJR75ARWHJ7J6MATFG7DYTVFGXMPWUHABZMKVRXRHQEQG6HXUA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12uiCMvJ7pnwXfN57CVu8zR73tikwUZiXr3sG7Xotd9w6KVnViL, address:145.79.227.5:4229): protocol: read tcp 188.166.225.170:34024->145.79.227.5:4229: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998590773 (187h25m31.678786343s) [noise=true , address=145.79.227.37:4569 , piece_id=AJJ475MZRUJTD4KUIQIKB5O225R6XUF7JYU3T7X4NYJLPPTERNEA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT, address:145.79.227.37:4569): protocol: read tcp 188.166.225.170:46076->145.79.227.37:4569: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998625650 (187h25m31.678821219s) [noise=true , address=145.79.227.33:4873 , piece_id=OMRSTBQNWOLLXJ643OSJMPFWYDRPZUNLZ3KXHQVMTY2JXDJKCLZQ, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo, address:145.79.227.33:4873): protocol: read tcp 188.166.225.170:41652->145.79.227.33:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998661218 (187h25m31.678856787s) [noise=true , address=145.79.227.21:4493 , piece_id=CREIMVTKWUTL6CJ6OXLGFAIRWQCVALHK7VTZH5F3DHCQGNYGWQCA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12PUjzJu7JJ4q77xnkBEZtPV2bwg5UJtMBfkgnjuwdAHc7Ff5UD, address:145.79.227.21:4493): protocol: read tcp 188.166.225.170:47756->145.79.227.21:4493: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998758083 (187h25m31.678953643s) [noise=true , address=145.79.227.17:4001 , piece_id=T6COLXG447YAQ44I4EDFBGQSN2LB5QMLPHZM3CLPJP4PO7MV4QEQ, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw, address:145.79.227.17:4001): protocol: read tcp 188.166.225.170:40364->145.79.227.17:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998794172 (187h25m31.678989741s) [noise=true , address=145.79.227.32:4839 , piece_id=EVIFP2OODYST5B4XQLSJM7MWYIYSQASNVJGDHEX6MU2C7YI3IWGQ, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:1K6FBTsMRwN9ERP4hC8VkF6bUv1AhnVHLmmUCjwAhAVpNWfxjh, address:145.79.227.32:4839): protocol: read tcp 188.166.225.170:60948->145.79.227.32:4839: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998845250 (187h25m31.679040849s) [noise=true , address=145.79.227.49:4340 , piece_id=26PCT5WQTEMJ6LUIWY3KVZD5MMQ7L6W5MYCFYC4HFQWZXYYPCSCA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC, address:145.79.227.49:4340): protocol: read tcp 188.166.225.170:34822->145.79.227.49:4340: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998912780 (187h25m31.679108369s) [noise=true , address=45.91.116.5:4322 , piece_id=G3QKLOHGV5IUFUYBUUFAABKAYXOZPJPKHKXXRIUL3Q3AC5HHRUOA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12W3qDq8BssS8V6osW9NwFHZHMJcCRfjYP8qKwphE5SenVewWXy, address:45.91.116.5:4322): protocol: read tcp 188.166.225.170:42010->45.91.116.5:4322: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.998977423 (187h25m31.679173002s) [noise=true , address=145.79.227.18:4021 , piece_id=EDGFSU3DLU5MP34XOLU6SPG54EPRBD4WYPJXMX2KVKY77U4QPJSA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12ts2cPQYUxdscD7RBpVxiHk36KAtJnXnAP9FwY7gCpBXHeS1Cg, address:145.79.227.18:4021): protocol: read tcp 188.166.225.170:58890->145.79.227.18:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.999008783 (187h25m31.679204352s) [noise=true , address=77.90.31.17:4798 , piece_id=2GVJZ7TWAT77JCPFH36XSQF7WGBELD3FYE34MDKZTUSCL5FQJNJQ, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:123HQXrHXyyMYHd5j7nqjzdGWoNg6m8j1eejUcvHNRfCRaHjAWK, address:77.90.31.17:4798): protocol: read tcp 188.166.225.170:56284->77.90.31.17:4798: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.999043760 (187h25m31.679239329s) [noise=true , address=77.90.31.10:4542 , piece_id=GE72J5KY43LGRTTISDG2VT4JQVUUMKWAJU637QQTMMR4IV2U5FDA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:1T8wyLvnYL2oRtQUhw8FhVFZ98Q5DhyRv1EnkCNAbW8TqcAjJc, address:77.90.31.10:4542): protocol: read tcp 188.166.225.170:58660->77.90.31.10:4542: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.999056825 (187h25m31.679252384s) [noise=true , address=145.79.227.14:4852 , piece_id=SILSHUQOUOFQRTMFECLTOQHKGUXZYZENZIQEL2NNZSIDNBYVD5DA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:12sQvAZS92R7TTJUFjMRieYT6BP4vp2UAan4PHrhPt6m3eHPukN, address:145.79.227.14:4852): protocol: read tcp 188.166.225.170:57664->145.79.227.14:4852: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.999084879 (187h25m31.679280448s) [noise=true , address=145.79.227.30:4768 , piece_id=UA4EERV2JVYWIQ2Q4VXC63Q44AMORALYC5JNLITGKI4CHPW54KTA, seg_pos={0 0}, upload=164925]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: read tcp 188.166.225.170:52124->145.79.227.30:4768: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:33:34.999101460 (187h25m31.679297029s) [seg_pos={0 0}, upload=164925]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 2m25.898782332s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 4.133645761s FAIL (2025-09-06 09:34:57 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 4.133689805s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 1m0.183556106s FAIL (2025-09-06 09:34:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 6) ======LOGS====== n closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.915851687 (187h26m50.596047256s) [noise=true , address=185.167.204.205:4021 , piece_id=SOA4KECT6ZTZCIPLG6HQBKHCLDTNHGVY6BRVMHFXNPZTOPAXRT2Q, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:57614->185.167.204.205:4021: use of closed network connection; write tcp 188.166.225.170:57614->185.167.204.205:4021: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57614->185.167.204.205:4021: use of closed network connection Sep 6 09:34:53.915966536 (187h26m50.596162095s) [noise=true , address=81.171.14.70:4028 , piece_id=C4YSZEBCWUF6IP6QEPBXZJGWZH6J4P43EMOI5WJAVWO27UZHF56A, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:50054->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:50054->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50054->81.171.14.70:4028: use of closed network connection Sep 6 09:34:53.916009469 (187h26m50.596205028s) [noise=true , address=185.167.204.205:4026 , piece_id=5JKPXJNF7KIONB2MSFDXFB75YVJPPDVDUOTMGJEJCAUS222A6A2A, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: write tcp 188.166.225.170:58824->185.167.204.205:4026: use of closed network connection; write tcp 188.166.225.170:58824->185.167.204.205:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58824->185.167.204.205:4026: use of closed network connection Sep 6 09:34:53.916082458 (187h26m50.596278027s) [noise=true , address=185.167.204.206:4067 , piece_id=PVWVOSH5XAOEBL7DSZ4DK5O56OIKZ356WXW7OZXPNI3GLTPGR5BQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: write tcp 188.166.225.170:60408->185.167.204.206:4067: use of closed network connection; write tcp 188.166.225.170:60408->185.167.204.206:4067: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60408->185.167.204.206:4067: use of closed network connection Sep 6 09:34:53.916116374 (187h26m50.596311943s) [noise=true , address=185.167.204.206:4061 , piece_id=XAWB37EXYREDJKQK7YHJ4GP77KDWILA5OFGDPKZMNAOMQE7IYKUA, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 188.166.225.170:51882->185.167.204.206:4061: use of closed network connection; write tcp 188.166.225.170:51882->185.167.204.206:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51882->185.167.204.206:4061: use of closed network connection Sep 6 09:34:53.916152592 (187h26m50.596348162s) [noise=true , address=81.171.14.70:4033 , piece_id=AZGFSVMDWZRQ4RAKL77DK7AF466PUGGFWJKRHOGCWX5DWUNKGQCQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:55854->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:55854->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55854->81.171.14.70:4033: use of closed network connection Sep 6 09:34:53.916181959 (187h26m50.596377518s) [noise=true , address=185.167.204.206:4053 , piece_id=DW2PHDVBHDCILM6C2ZOTWRJ2VVOXS4HWMGJ3VZOR5PQREVWKNY4Q, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: write tcp 188.166.225.170:36298->185.167.204.206:4053: use of closed network connection; write tcp 188.166.225.170:36298->185.167.204.206:4053: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36298->185.167.204.206:4053: use of closed network connection Sep 6 09:34:53.916214811 (187h26m50.59641038s) [noise=true , address=185.167.204.206:4046 , piece_id=GTA6OSWDEZWQFHLUU5CFM4R75ZPJSV7LZYSEGMDGJQA4TIYYPWLA, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: read tcp 188.166.225.170:49892->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.916358066 (187h26m50.596553625s) [noise=true , address=81.171.14.70:4040 , piece_id=ZKCL6AWPA37HHD4NBHJFO4SUPM7I3NZXB7FLXDOXYOM7F4KDUYSQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:32874->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.916387022 (187h26m50.596582591s) [noise=true , address=185.167.204.206:4071 , piece_id=UBAOE7YPCQQQVFHULL4PKCPQZ3W6UBRAS2KGT4YF77SGZE7C6YOA, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: read tcp 188.166.225.170:59736->185.167.204.206:4071: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.916412009 (187h26m50.596607568s) [noise=true , address=185.167.204.205:4031 , piece_id=VRGU66N3K3WJS5K2CSJW6NR3I24PHAVFAFFE672FC6UWE6I6FLLQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:37748->185.167.204.205:4031: use of closed network connection; write tcp 188.166.225.170:37748->185.167.204.205:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37748->185.167.204.205:4031: use of closed network connection Sep 6 09:34:53.916437227 (187h26m50.596632796s) [noise=true , address=81.171.14.70:4045 , piece_id=QEL32UXZVGZDYKLDXIYAIT6V7QQLMHSFIBHLV7SEJ2UTNZYPKLCQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 188.166.225.170:52870->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.916472906 (187h26m50.596668465s) [noise=true , address=185.167.204.206:4049 , piece_id=JROLHCTUSNM67UECY27XQG7TZDDNMUAMZAFICMB62F3VCLIK4CEA, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: read tcp 188.166.225.170:56694->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.916525937 (187h26m50.596721496s) [noise=true , address=185.167.204.205:4013 , piece_id=GD2LXAYJNZRLC6WXWF2RUXGMXS7IXUKZFJSMZ4WW5373QT32IOLQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: read tcp 188.166.225.170:38508->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.916546646 (187h26m50.596742215s) [noise=true , address=185.167.204.205:4009 , piece_id=LXITCQOKRJMWG7GXR4S2F54YFKJ27PVO5UA3WV66LTLL3B3GA2FQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:36548->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:36548->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36548->185.167.204.205:4009: use of closed network connection Sep 6 09:34:53.916567546 (187h26m50.596763115s) [noise=true , address=185.167.204.206:4052 , piece_id=6JW4T3MUATYDSB22BSWOQC4MBYL5Y5RGZCU3UFI4WOVHRS6NKAIA, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: read tcp 188.166.225.170:33164->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:53.916633643 (187h26m50.596829212s) [noise=true , address=185.167.204.205:4033 , piece_id=BQE5KCJ4XTSN5VZKAGCF3YGTUQTSMEA4FLKIROEDC4HGVNOG7KAQ, seg_pos={0 0}, upload=164936]: Done uploading piece. err: ecclient: upload failed (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, address:185.167.204.205:4033): protocol: read tcp 188.166.225.170:56172->185.167.204.205:4033: use of closed network connection; context deadline exceeded Sep 6 09:34:53.916660475 (187h26m50.596856044s) [seg_pos={0 0}, upload=164936]: Done waiting for segment. successful: 6 optimal: 26 errs: <nil> Sep 6 09:34:54.096258953 (187h26m50.776454532s) [upload=164936]: Done uploading segments... Sep 6 09:34:54.096330320 (187h26m50.776525909s) [upload=164936]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 6) Duration: 1m0.183581915s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 4 out of 60 is failed (threshold=3) [..................................................XX...XX...] duration: 22.052648318s FAIL (2025-09-06 09:34:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:31:41.360710528 (187h23m38.040906097s) [upload=164914]: Starting upload Sep 6 09:31:41.360783447 (187h23m38.040979016s) [upload=164914]: Done starting upload Sep 6 09:31:41.360862178 (187h23m38.041057747s) [upload=164914]: Uploading segments... Sep 6 09:31:41.360909148 (187h23m38.041104747s) [upload=164914]: Got next segment. Inline: true Sep 6 09:31:41.360914728 (187h23m38.041110297s) [upload=164914]: Waiting for error group managing segments... Sep 6 09:31:41.360984312 (187h23m38.041179881s) [upload=164914]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:31:41.360989862 (187h23m38.041185431s) [upload=164914]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:31:41.360992587 (187h23m38.041188156s) [upload=164914]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:32:39.493273014 (187h24m36.173468573s) [upload=164914]: Done uploading segments... Sep 6 09:32:39.493295748 (187h24m36.173491317s) [upload=164914]: Upload finished. err: metaclient: context deadline exceeded Duration:* 22.052680379s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 9 out of 60 is failed (threshold=3) [..............................................X.X.X.X.XX.XXX] duration: 30.000700672s FAIL (2025-09-06 09:34:51 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.000710982s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration: 30.001284439s FAIL (2025-09-06 09:34:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001294037s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration: 30.44119887s FAIL (2025-09-06 09:34:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== ) [noise=true , address=45.91.116.13:4154 , piece_id=BD2JGK2SPMHSAZTNCGHHYQXFTEFZQSY5BCSJH63BJPWP6PV764PQ, seg_pos={0 0}, upload=164943]: Uploading piece... Sep 6 09:34:19.852124567 (187h26m16.532320136s) [noise=true , address=45.91.116.13:4153 , piece_id=JEANYKLS65DJDQSXFX37O4YNOU5ZUMRFG3FE36AFH2UL7SGYEV4Q, seg_pos={0 0}, upload=164943]: Uploading piece... Sep 6 09:34:19.852342273 (187h26m16.532537842s) [noise=true , address=45.91.116.9:4263 , piece_id=SDCSNOWS5MVMPDCFCMQ7EMKLLPZUNUALOGRBJNZM7KYAGS4HJQAA, seg_pos={0 0}, upload=164943]: Uploading piece... Sep 6 09:34:19.852579768 (187h26m16.532775337s) [noise=true , address=45.91.116.8:4045 , piece_id=MISUO4FFXUZFWRVSJIOBBTXUTL2PXMVSFI6Y4W7T4BFWE2N3YTUA, seg_pos={0 0}, upload=164943]: Uploading piece... Sep 6 09:34:19.852830277 (187h26m16.533025846s) [noise=true , address=45.91.116.11:4118 , piece_id=JMUWHQ7XAQU7LHBOLUCDQ2NXCN4KL7Z7FDBB4V5SPO4X7AKMVQ6A, seg_pos={0 0}, upload=164943]: Uploading piece... Sep 6 09:34:19.853016533 (187h26m16.533212102s) [noise=true , address=45.91.116.10:4082 , piece_id=EYEYWICL7EFVPAJHPDSZ6HTHYFBWNITFYGJLG6STHLJHQFZSJOKA, seg_pos={0 0}, upload=164943]: Uploading piece... Sep 6 09:34:43.283384966 (187h26m39.963580535s) [upload=164943]: Next segment err: context deadline exceeded Sep 6 09:34:43.283603905 (187h26m39.963799474s) [noise=true , address=45.91.116.14:4189 , piece_id=EJWJIN6SVO2DRRIJCK346CJCCIUGJYEUGS5AMWY2LMDIJ6G3EISQ, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:39476->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:39476->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39476->45.91.116.14:4189: use of closed network connection Sep 6 09:34:43.283822072 (187h26m39.964017641s) [noise=true , address=77.90.31.21:4877 , piece_id=32NJ6KHQJ2VJ5LCRXSUQG27FEFTXC5TAPM6SX7OTJ3GIQIFCGF2A, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 188.166.225.170:34458->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.283854064 (187h26m39.964049633s) [noise=true , address=45.91.116.10:4083 , piece_id=65AMTP6LEAZCQH6JVL77O4GHBRC37UF535AHQXGNYYUQQNH32DNA, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:51744->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.283941601 (187h26m39.964137171s) [noise=true , address=45.91.116.10:4082 , piece_id=EYEYWICL7EFVPAJHPDSZ6HTHYFBWNITFYGJLG6STHLJHQFZSJOKA, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 188.166.225.170:57504->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:57504->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57504->45.91.116.10:4082: use of closed network connection Sep 6 09:34:43.284031353 (187h26m39.964226912s) [noise=true , address=77.90.31.12:4592 , piece_id=5UPGMRBBO4JEQRH2PIGQ7MUNMU24SCLVQDATCVYL3FCE7DVRED2A, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:52804->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:52804->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52804->77.90.31.12:4592: use of closed network connection Sep 6 09:34:43.284120704 (187h26m39.964316273s) [noise=true , address=45.91.116.13:4154 , piece_id=BD2JGK2SPMHSAZTNCGHHYQXFTEFZQSY5BCSJH63BJPWP6PV764PQ, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 188.166.225.170:54636->45.91.116.13:4154: use of closed network connection; write tcp 188.166.225.170:54636->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54636->45.91.116.13:4154: use of closed network connection Sep 6 09:34:43.284196659 (187h26m39.964392218s) [noise=true , address=45.91.116.9:4263 , piece_id=SDCSNOWS5MVMPDCFCMQ7EMKLLPZUNUALOGRBJNZM7KYAGS4HJQAA, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:59814->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:59814->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59814->45.91.116.9:4263: use of closed network connection Sep 6 09:34:43.284253087 (187h26m39.964448656s) [noise=true , address=45.91.116.13:4153 , piece_id=JEANYKLS65DJDQSXFX37O4YNOU5ZUMRFG3FE36AFH2UL7SGYEV4Q, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 188.166.225.170:39112->45.91.116.13:4153: use of closed network connection; write tcp 188.166.225.170:39112->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39112->45.91.116.13:4153: use of closed network connection Sep 6 09:34:43.284519527 (187h26m39.964715096s) [noise=true , address=77.90.31.10:4520 , piece_id=VRIY2YRSQBGMK4ME6Z4BIYPW2JKVO4Q2SRBBHE6CB2Q4V3F3IU3Q, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 188.166.225.170:48294->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284565706 (187h26m39.964761265s) [noise=true , address=77.90.31.10:4519 , piece_id=JAGFHMC4SUDNESOMOUMTJOSVXY47YZUPHLZF6DA4VWVWAFNYW2ZQ, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 188.166.225.170:35820->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284609359 (187h26m39.964804928s) [noise=true , address=45.91.116.14:4191 , piece_id=XKI45FUQUYK4MPLGYLF4YS2QXOORUSRDE7AND7GVP3JQZT2OGJSQ, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 188.166.225.170:48900->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284705183 (187h26m39.964900752s) [noise=true , address=77.90.31.21:4878 , piece_id=QFT5JRXJCJFKGJGDMODRKYFD6UTBEVY4ZPJHBTFIMBD3R5LSXQ4Q, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 188.166.225.170:49966->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284746732 (187h26m39.964942301s) [noise=true , address=45.91.116.12:4226 , piece_id=RFXPPLJLC24XWM6Q6N63JMCRAN5UZCSS4MQ6BJEKYOBDKWHRVELQ, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 188.166.225.170:47920->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284776078 (187h26m39.964971647s) [noise=true , address=45.91.116.11:4118 , piece_id=JMUWHQ7XAQU7LHBOLUCDQ2NXCN4KL7Z7FDBB4V5SPO4X7AKMVQ6A, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 188.166.225.170:60742->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284792760 (187h26m39.964988329s) [noise=true , address=77.90.31.15:4699 , piece_id=XGTZPEL7BGVV3NTXQWJBUUSBFT6VCDBQAICGB47KUUOPBURDL27A, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: read tcp 188.166.225.170:51578->77.90.31.15:4699: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284821585 (187h26m39.965017154s) [noise=true , address=45.91.116.8:4045 , piece_id=MISUO4FFXUZFWRVSJIOBBTXUTL2PXMVSFI6Y4W7T4BFWE2N3YTUA, seg_pos={0 0}, upload=164943]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: read tcp 188.166.225.170:44654->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:43.284868555 (187h26m39.965064134s) [seg_pos={0 0}, upload=164943]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.441211605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.441748382s FAIL (2025-09-06 09:34:43 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 45) Duration: 30.441761415s core uplink us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 9.107265933s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:34:37 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 9.107291012s edge linksharing us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X.X.] duration: 4.333281523s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:34:30 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 4.333301351s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 4 out of 60 is failed (threshold=3) [...................................................XX...XX..] duration: 43.164444309s FAIL (2025-09-06 09:34:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:31:41.360710528 (187h23m38.040906097s) [upload=164914]: Starting upload Sep 6 09:31:41.360783447 (187h23m38.040979016s) [upload=164914]: Done starting upload Sep 6 09:31:41.360862178 (187h23m38.041057747s) [upload=164914]: Uploading segments... Sep 6 09:31:41.360909148 (187h23m38.041104747s) [upload=164914]: Got next segment. Inline: true Sep 6 09:31:41.360914728 (187h23m38.041110297s) [upload=164914]: Waiting for error group managing segments... Sep 6 09:31:41.360984312 (187h23m38.041179881s) [upload=164914]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:31:41.360989862 (187h23m38.041185431s) [upload=164914]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:31:41.360992587 (187h23m38.041188156s) [upload=164914]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:32:39.493273014 (187h24m36.173468573s) [upload=164914]: Done uploading segments... Sep 6 09:32:39.493295748 (187h24m36.173491317s) [upload=164914]: Upload finished. err: metaclient: context deadline exceeded Duration:* 43.164470729s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 9 out of 60 is failed (threshold=3) [.............................................XXXXXX.....XXX.] duration: 15.641392047s FAIL (2025-09-06 09:34:28 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 15.641419772s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................X.X] duration: 2m0.000538234s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:34:25 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2m0.000549976s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.982958892s FAIL (2025-09-06 09:34:21 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 5.982984222s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration: 30.000716507s FAIL (2025-09-06 09:34:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000728269s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration: 33.502219565s FAIL (2025-09-06 09:34:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== SMZ4CNNIXAEE4FYHNWQ, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.092456290 (187h26m0.772651859s) [noise=true , address=45.91.116.6:4974 , piece_id=GR7GR7ZZ3PONNVESZLULDGSGJ37M4RXT2XV47NMHVEYCUTZ5GAGA, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.092595075 (187h26m0.772790674s) [noise=true , address=45.91.116.12:4227 , piece_id=BXIZIHTV36SR2UKUT6BZD2PVVSX3SDVLPLGC3HLF4CT5WWU7JQIA, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.092696539 (187h26m0.772892098s) [noise=true , address=45.91.116.11:4119 , piece_id=XQEUQZ4I6MCJLUAKAPQTZTRAMQL4YMTXIEKCZWTAYOB4VKIEMDCA, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.092912572 (187h26m0.773108131s) [noise=true , address=77.90.31.14:4663 , piece_id=ENIVIAULDCIUA5JGEUODJMHFQJR3L22YQ3U7V6VMDB7YVJ636R2Q, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.092946788 (187h26m0.773142357s) [noise=true , address=45.91.116.12:4226 , piece_id=2BSXCR637GMOXM5EL3AMPTANCDM3LQFDLIYDJX7RLDAML4ECCC3Q, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.093194172 (187h26m0.773389731s) [noise=true , address=77.90.31.12:4592 , piece_id=HS3PL3BRR2XCZK33AM3PE75FMZZ6TB6LJRQ4WNCRUIZLOB7ZMZ6Q, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.093199492 (187h26m0.773395061s) [noise=true , address=77.90.31.19:4841 , piece_id=A5NU2YGD5VABAXAAA6SLV43P4O3PDL5BZ66VKMATAKNB5HV6YTRQ, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.093437197 (187h26m0.773632766s) [noise=true , address=45.91.116.4:4937 , piece_id=LKM4YIRAKU4MPPAW4TWIKVDEVT3LKJLMRV74RVGEZMJODSWE75JA, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.093647639 (187h26m0.773843208s) [noise=true , address=77.90.31.16:4734 , piece_id=R34LFKKADMDC3Z4A5THBKLZJWT36XO5YBTLC4SPXSKU75JYVJJCQ, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:04.093895944 (187h26m0.774091513s) [noise=true , address=77.90.31.17:4771 , piece_id=LQ62HZOLQLVEMM4UZWVAP7OXDMH46BVQGSZJH2VIYF4YM2KAVCNA, seg_pos={0 0}, upload=164935]: Uploading piece... Sep 6 09:34:09.537417195 (187h26m6.217612764s) [upload=164935]: Next segment err: context deadline exceeded Sep 6 09:34:09.538162741 (187h26m6.21835831s) [noise=true , address=77.90.31.12:4590 , piece_id=ECRAWWFW6BRTMT7UZLV5SUSPW6DIJ2STHNHGU3MJGTXL2VVGNWDQ, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 188.166.225.170:40992->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538207878 (187h26m6.218403447s) [noise=true , address=77.90.31.14:4663 , piece_id=ENIVIAULDCIUA5JGEUODJMHFQJR3L22YQ3U7V6VMDB7YVJ636R2Q, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 188.166.225.170:56972->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538244919 (187h26m6.218440488s) [noise=true , address=77.90.31.19:4841 , piece_id=A5NU2YGD5VABAXAAA6SLV43P4O3PDL5BZ66VKMATAKNB5HV6YTRQ, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50714->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538277211 (187h26m6.21847278s) [noise=true , address=45.91.116.14:4191 , piece_id=V3OCS64GQTKNXU4AZT75ARZCXZAIOVQXGS2N7VVIEVDC2ZUG3IUQ, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 188.166.225.170:42420->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538310104 (187h26m6.218505673s) [noise=true , address=77.90.31.12:4592 , piece_id=HS3PL3BRR2XCZK33AM3PE75FMZZ6TB6LJRQ4WNCRUIZLOB7ZMZ6Q, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: read tcp 188.166.225.170:52026->77.90.31.12:4592: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538342876 (187h26m6.218538446s) [noise=true , address=45.91.116.4:4937 , piece_id=LKM4YIRAKU4MPPAW4TWIKVDEVT3LKJLMRV74RVGEZMJODSWE75JA, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: read tcp 188.166.225.170:46516->45.91.116.4:4937: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538349689 (187h26m6.218545258s) [noise=true , address=45.91.116.12:4227 , piece_id=BXIZIHTV36SR2UKUT6BZD2PVVSX3SDVLPLGC3HLF4CT5WWU7JQIA, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: rpc: dial tcp 45.91.116.12:4227: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538372914 (187h26m6.218568483s) [noise=true , address=77.90.31.17:4771 , piece_id=LQ62HZOLQLVEMM4UZWVAP7OXDMH46BVQGSZJH2VIYF4YM2KAVCNA, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: read tcp 188.166.225.170:44348->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538548390 (187h26m6.218743949s) [noise=true , address=45.91.116.6:4975 , piece_id=H5FBGZEHYGRYIOYQRROQU3P7MQFU7RCVYX4YDUY2LT4JIRXFB3WA, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538616310 (187h26m6.218811879s) [noise=true , address=77.90.31.13:4627 , piece_id=TZVVIAA3DZVJNTOLZBYAGHBDXFDGBHTV2DZAGVY2XTACNGOO5XIQ, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: read tcp 188.166.225.170:39570->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538652579 (187h26m6.218848148s) [noise=true , address=45.91.116.11:4119 , piece_id=XQEUQZ4I6MCJLUAKAPQTZTRAMQL4YMTXIEKCZWTAYOB4VKIEMDCA, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 188.166.225.170:52604->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538676495 (187h26m6.218872064s) [noise=true , address=45.91.116.6:4974 , piece_id=GR7GR7ZZ3PONNVESZLULDGSGJ37M4RXT2XV47NMHVEYCUTZ5GAGA, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: read tcp 188.166.225.170:58430->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538691784 (187h26m6.218887353s) [noise=true , address=77.90.31.16:4734 , piece_id=R34LFKKADMDC3Z4A5THBKLZJWT36XO5YBTLC4SPXSKU75JYVJJCQ, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: read tcp 188.166.225.170:58644->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538729426 (187h26m6.218924995s) [noise=true , address=77.90.31.17:4770 , piece_id=3GE6WY4QVBJXENVNLMV72RH3GBJRMDGOQSMZ4CNNIXAEE4FYHNWQ, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 188.166.225.170:57008->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538734616 (187h26m6.218930185s) [noise=true , address=45.91.116.12:4226 , piece_id=2BSXCR637GMOXM5EL3AMPTANCDM3LQFDLIYDJX7RLDAML4ECCC3Q, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: read tcp 188.166.225.170:45712->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538768922 (187h26m6.218964491s) [noise=true , address=77.90.31.10:4520 , piece_id=ZENOGSWDGNNJG6OO6U2UAE46IQACRXULBUXQDXFSOUYRSQTDFC3Q, seg_pos={0 0}, upload=164935]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 188.166.225.170:46020->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:34:09.538835339 (187h26m6.219030908s) [seg_pos={0 0}, upload=164935]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 33.502243061s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 3m34.753008817s FAIL (2025-09-06 09:34:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3m34.753020239s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 4 out of 60 is failed (threshold=3) [...................................................XXX....X.] duration: 15.688688196s remote: "tcp:35.212.10.183:443" target: https://us1.storj.io/login FAIL (2025-09-06 09:34:09 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 15.688703086s core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............................................X..X....X.X..] duration: 5.628732097s FAIL (2025-09-06 09:34:08 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47) Duration: 5.628776442s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXX..] duration: 18.539174502s FAIL (2025-09-06 09:34:06 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 18.539196585s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 1m0.000654162s FAIL (2025-09-06 09:34:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000673839s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 3.369377526s FAIL (2025-09-06 09:34:00 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 3.369408346s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 9 out of 60 is failed (threshold=3) [..............................................XXXXXX.....XXX] duration: 30.001442426s FAIL (2025-09-06 09:33:53 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 30.001454059s core uplink us-select-1

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)