Orbiter History

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [........................................X.X..X.XX...........] duration: 30.052784327s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:49:22 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 30.052797972s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 24 out of 60 is failed (threshold=3) [...................................XXXXXXXXXXXXXXXXXXXXXXXX.] duration: 5.566526798s FAIL (2025-09-06 09:49:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.566546035s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 12 out of 60 is failed (threshold=3) [..................................XX...XX....XXXX..XX..XX...] duration: 9.56146362s FAIL (2025-09-06 09:49:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload Sep 6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload Sep 6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments... Sep 6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true Sep 6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments... Sep 6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments... Sep 6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil> Duration:* 9.561487536s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [............................XXX....X.XX..X..................] duration: 746.787918ms target: https://us1.storj.io/login FAIL (2025-09-06 09:49:19 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 746.813397ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 21 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXX...XXXXXX...X.X...X..] duration: 17.480804622s FAIL (2025-09-06 09:49:19 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 17.480887973s edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.........................X....XX] duration: 30.026274748s FAIL (2025-09-06 09:49:18 UTC) operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 44) Duration: 30.026299396s core uplink ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 24 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.000462699s FAIL (2025-09-06 09:49:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000483417s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [.............................XXX....X.XX..X.................] duration: 14.952356298s target: https://us1.storj.io/login FAIL (2025-09-06 09:49:10 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 14.952383331s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 31 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.439893315s FAIL (2025-09-06 09:49:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 7N3JQ, seg_pos={0 0}, upload=165133]: Uploading piece... Sep 6 09:48:37.235101266 (187h40m33.915296835s) [noise=true , address=77.90.31.16:4734 , piece_id=EJCMCDAJ2MNO3TBGAESVUIRC6MFCMCE5RHOSL2VYAB2O3RNR2PVA, seg_pos={0 0}, upload=165133]: Uploading piece... Sep 6 09:48:37.235220855 (187h40m33.915416424s) [noise=true , address=45.91.116.6:4975 , piece_id=4B4E7OT5JVJBUNN4ZUZ5FKRC26BGZKBLKUTOZFDKO2IRDRCC3SDA, seg_pos={0 0}, upload=165133]: Uploading piece... Sep 6 09:48:37.235421539 (187h40m33.915617108s) [noise=true , address=45.91.116.11:4117 , piece_id=GVDJ2SDK2TSG2JE652PLZOSO2UV4K4VOWZ6UXH4BUG3LUWOMYWVQ, seg_pos={0 0}, upload=165133]: Uploading piece... Sep 6 09:48:37.235433181 (187h40m33.91562875s) [noise=true , address=77.90.31.18:4806 , piece_id=FZGQ24A3E5W2WVD7Q22OIW54U77WZF57ZOXNEOYPOAOUY4ZXLYHQ, seg_pos={0 0}, upload=165133]: Uploading piece... Sep 6 09:48:37.235644736 (187h40m33.915840305s) [noise=true , address=45.91.116.8:4048 , piece_id=AFB2GS6PNU7P6JKSETSTX46KJPERVCBE4YBNKGRFGWD6K7HKIIXQ, seg_pos={0 0}, upload=165133]: Uploading piece... Sep 6 09:48:37.235709700 (187h40m33.915905269s) [noise=true , address=45.91.116.10:4083 , piece_id=B76CYZG6IRYJVE5VW6WELIEJHBWT4GHXK3NMZET3J25KZLLAZZGQ, seg_pos={0 0}, upload=165133]: Uploading piece... Sep 6 09:49:05.524260987 (187h41m2.204456556s) [upload=165133]: Next segment err: context deadline exceeded Sep 6 09:49:05.525151190 (187h41m2.205346759s) [noise=true , address=77.90.31.16:4734 , piece_id=EJCMCDAJ2MNO3TBGAESVUIRC6MFCMCE5RHOSL2VYAB2O3RNR2PVA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525269517 (187h41m2.205465086s) [noise=true , address=77.90.31.18:4806 , piece_id=FZGQ24A3E5W2WVD7Q22OIW54U77WZF57ZOXNEOYPOAOUY4ZXLYHQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33854->77.90.31.18:4806: use of closed network connection Sep 6 09:49:05.525307279 (187h41m2.205502848s) [noise=true , address=45.91.116.7:4011 , piece_id=JEKHNX25SUJ7XXI7WFJSABFK7C6GYSCX7O5WKID3ZVDZKBIUCM5Q, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection; write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37906->45.91.116.7:4011: use of closed network connection Sep 6 09:49:05.525345782 (187h41m2.205541351s) [noise=true , address=45.91.116.14:4189 , piece_id=GKEQ2IYP2FO2MFJGTXLQRUMA4BBM3A2TZYZLDCZ6GNJCNRFIKLBA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55912->45.91.116.14:4189: use of closed network connection Sep 6 09:49:05.525387101 (187h41m2.20558267s) [noise=true , address=45.91.116.6:4975 , piece_id=4B4E7OT5JVJBUNN4ZUZ5FKRC26BGZKBLKUTOZFDKO2IRDRCC3SDA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection; write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34404->45.91.116.6:4975: use of closed network connection Sep 6 09:49:05.525432948 (187h41m2.205628517s) [noise=true , address=45.91.116.8:4048 , piece_id=AFB2GS6PNU7P6JKSETSTX46KJPERVCBE4YBNKGRFGWD6K7HKIIXQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 188.166.225.170:58976->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525464129 (187h41m2.205659688s) [noise=true , address=45.91.116.5:4298 , piece_id=ACPADRRAY3XCMND27HLWYTHBYN6JYJHX65TGHOYX6KQLAQ4H2IEA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 188.166.225.170:37724->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525495419 (187h41m2.205690988s) [noise=true , address=45.91.116.10:4082 , piece_id=BHVWAODV7TRSZVHBHIB6WOZRUDMLH4PYSGWPFMZDO2YZTX5J4FCQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: read tcp 188.166.225.170:34896->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525517281 (187h41m2.20571285s) [noise=true , address=45.91.116.5:4297 , piece_id=FM3W57L7DQXWDHRD45GB55M3EFWZC6F4F5MPOUND437L4VUHX5BA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525581042 (187h41m2.205776621s) [noise=true , address=45.91.116.14:4191 , piece_id=QSLHTOV3OHJ6ON4CPQOQFOWV3NW7MFVQ5R2G44O3VUBU3X3YEFWA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection; write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34852->45.91.116.14:4191: use of closed network connection Sep 6 09:49:05.525641939 (187h41m2.205837508s) [noise=true , address=45.91.116.13:4155 , piece_id=XV4N554TZTQFX5NE2LX6TRIGVG7TAXCZSQ7WCOQEK2WNZNWRVKLQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41822->45.91.116.13:4155: use of closed network connection Sep 6 09:49:05.525702134 (187h41m2.205897703s) [noise=true , address=45.91.116.6:4974 , piece_id=VF7QLD6YLKXRLBTNJ3C3JXTPVBM3TBGQNJNH47KJW7RWXVC5KW4A, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: read tcp 188.166.225.170:44540->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525739145 (187h41m2.205934714s) [noise=true , address=45.91.116.11:4117 , piece_id=GVDJ2SDK2TSG2JE652PLZOSO2UV4K4VOWZ6UXH4BUG3LUWOMYWVQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:54696->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525773911 (187h41m2.20596948s) [noise=true , address=45.91.116.4:4938 , piece_id=4QW76PY2ZTXFMNTG75PVJGEEQG5OUZSTHRUOY4JB5N3NRNLVSSHA, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: read tcp 188.166.225.170:57880->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525780784 (187h41m2.205976353s) [noise=true , address=45.91.116.10:4083 , piece_id=B76CYZG6IRYJVE5VW6WELIEJHBWT4GHXK3NMZET3J25KZLLAZZGQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:51536->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525841049 (187h41m2.206036618s) [noise=true , address=45.91.116.6:4973 , piece_id=X7D4J4KTTIWBNVAOPMTMP3N6X6EE5VZLAGEZLWIWGLDBIUB7N3JQ, seg_pos={0 0}, upload=165133]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:43034->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:49:05.525861449 (187h41m2.206057018s) [seg_pos={0 0}, upload=165133]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.439919084s core uplink us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 857.112669ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:49:01 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 857.135622ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 15 out of 60 is failed (threshold=3) [...........................X.X.X.X.XX.XXX.X..X...X..X.....XX] duration: 30.002259252s FAIL (2025-09-06 09:49:00 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.002277999s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 8 out of 60 is failed (threshold=3) [...........................X..X....X.X........X.X....X..X...] duration: 5.977280432s FAIL (2025-09-06 09:48:56 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 45) Duration: 5.977309279s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 7 out of 60 is failed (threshold=3) [.....................................X..X..X..X.X.....X.X...] duration: 4.016159871s FAIL (2025-09-06 09:48:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 4.016192593s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX] duration: 30.001302397s FAIL (2025-09-06 09:48:53 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.00136698s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 12 out of 60 is failed (threshold=3) [...................................XX...XX....XXXX..XX..XX..] duration: 38.480545972s FAIL (2025-09-06 09:48:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload Sep 6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload Sep 6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments... Sep 6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true Sep 6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments... Sep 6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments... Sep 6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil> Duration:* 38.480572393s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [.........................................X.X..X.XX..........] duration: 1m29.632305781s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:48:52 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 1m29.632328824s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 17 out of 60 is failed (threshold=3) [..........................XXXXXX.....XXX.X.X.XXXX.......X..X] duration: 30.001557663s FAIL (2025-09-06 09:48:47 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:48:21.207202480 (187h40m17.887398049s) [upload=165129]: Starting upload Sep 6 09:48:21.207262054 (187h40m17.887457623s) [upload=165129]: Done starting upload Sep 6 09:48:21.207314074 (187h40m17.887509643s) [upload=165129]: Uploading segments... Sep 6 09:48:21.207347838 (187h40m17.887543407s) [upload=165129]: Got next segment. Inline: true Sep 6 09:48:21.207351706 (187h40m17.887547275s) [upload=165129]: Waiting for error group managing segments... Sep 6 09:48:21.207382404 (187h40m17.887577973s) [upload=165129]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:48:21.207386171 (187h40m17.88758174s) [upload=165129]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:48:21.207388706 (187h40m17.887584275s) [upload=165129]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:48:37.834981681 (187h40m34.51517725s) [upload=165129]: Done uploading segments... Sep 6 09:48:37.834999625 (187h40m34.515195194s) [upload=165129]: Upload finished. err: <nil> Duration:* 30.001579043s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 32 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.000833217s FAIL (2025-09-06 09:48:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000844057s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.174255444s FAIL (2025-09-06 09:48:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 8) ======LOGS====== s:81.171.14.70:4026): protocol: write tcp 188.166.225.170:37680->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:37680->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37680->81.171.14.70:4026: use of closed network connection Sep 6 09:48:29.979618753 (187h40m26.659814313s) [noise=true , address=185.167.204.206:4063 , piece_id=ZNQZGASS23BBZDQUHPDRW6RC2NB22JIDOMWY47GC4QWEIPC2ZANQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: read tcp 188.166.225.170:41060->185.167.204.206:4063: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:29.979667427 (187h40m26.659862986s) [noise=true , address=81.171.14.70:4038 , piece_id=3QZEQRVKZSTB3BY2DMT5IPSWWRDXGJRHHS4YVZHHZKIWP62Q5YIA, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:57348->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:57348->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57348->81.171.14.70:4038: use of closed network connection Sep 6 09:48:29.979775995 (187h40m26.659971564s) [noise=true , address=185.167.204.206:4044 , piece_id=DBBNOOR3D7RUD3XDGJNO2E3DWQI5FP4WMOED2ZX2AFUIT5EF6WAQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: write tcp 188.166.225.170:50686->185.167.204.206:4044: use of closed network connection; write tcp 188.166.225.170:50686->185.167.204.206:4044: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50686->185.167.204.206:4044: use of closed network connection Sep 6 09:48:29.979831330 (187h40m26.6600269s) [noise=true , address=185.167.204.206:4050 , piece_id=CCJS2UZWLZG3FREXZPDNBPB7FHDYPHLII5YMUD7M7BPCDUKZCPHQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:48:29.979887488 (187h40m26.660083057s) [noise=true , address=81.171.14.70:4037 , piece_id=54QWE3DPV44EQDUVFIPMRMVB6TZDQ3ZQUCLWBNDOPO32IYI7RKQA, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:48:29.979944747 (187h40m26.660140326s) [noise=true , address=185.167.204.205:4034 , piece_id=5XH3BSKBFKYNPMJOD5C4MYE747NF4II44YBIMSXZCFN5YR4BZMMA, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:48:29.980025552 (187h40m26.660221121s) [noise=true , address=81.171.14.70:4030 , piece_id=M63T7TESHT3PCZZ27BS6QKHLUFJM4LLB33XUHQG4QPR74UMAWR2Q, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:36276->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:36276->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36276->81.171.14.70:4030: use of closed network connection Sep 6 09:48:29.980098691 (187h40m26.66029426s) [noise=true , address=81.171.14.70:4046 , piece_id=T7FG334IHI6PL4LNRAYSSEXMJFXOCKC4USXMA2XCVYZRGYFYLNUQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:48:29.980114592 (187h40m26.660310161s) [noise=true , address=185.167.204.205:4008 , piece_id=WRSFTB3IECAZWFZPXLTZVZMFSN3WIYXXUFQVJLPG65DXC3OIU7GQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 188.166.225.170:44824->185.167.204.205:4008: use of closed network connection; write tcp 188.166.225.170:44824->185.167.204.205:4008: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44824->185.167.204.205:4008: use of closed network connection Sep 6 09:48:29.980230784 (187h40m26.660426353s) [noise=true , address=185.167.204.206:4056 , piece_id=VO2JHPDLUQMUGXUIDS6RJX555FS7QSC5NOBX734SJVKPCKC7CBJQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: write tcp 188.166.225.170:41834->185.167.204.206:4056: use of closed network connection; write tcp 188.166.225.170:41834->185.167.204.206:4056: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41834->185.167.204.206:4056: use of closed network connection Sep 6 09:48:29.980340424 (187h40m26.660535993s) [noise=true , address=185.167.204.206:4046 , piece_id=5E5ZRQU7IMT3RMCVGY22W46WRM5ILATOYWM3CANZZSFWWBWV72NQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58712->185.167.204.206:4046: use of closed network connection; write tcp 188.166.225.170:58712->185.167.204.206:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58712->185.167.204.206:4046: use of closed network connection Sep 6 09:48:29.980358990 (187h40m26.660554679s) [noise=true , address=185.167.204.206:4066 , piece_id=XL7QBHQGBICXRSZPEZKOXTN3GULJIKPYKB6SAZNQBUDPDBJ7YZKQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:48:29.980418393 (187h40m26.660613962s) [noise=true , address=185.167.204.205:4012 , piece_id=GBDN5NIG2PX6OBY23MTRDALJ4YGOBGXOJPUXIFYEJRMROF4AEFKQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: read tcp 188.166.225.170:54728->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:29.980471916 (187h40m26.660667485s) [noise=true , address=185.167.204.205:4028 , piece_id=T3ORFLJADUQBSUIXAQ5YK4H5X74I25F2CHA4AE447PSQI56Q3T7Q, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: read tcp 188.166.225.170:44224->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:29.980494619 (187h40m26.660690219s) [noise=true , address=185.167.204.206:4055 , piece_id=OMIOA4OQQX4CDBRSISL24VGOR7SKUFYOLTHK3PGXU7QTPJAXJOVQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: write tcp 188.166.225.170:44784->185.167.204.206:4055: use of closed network connection; write tcp 188.166.225.170:44784->185.167.204.206:4055: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44784->185.167.204.206:4055: use of closed network connection Sep 6 09:48:29.980653163 (187h40m26.660848732s) [noise=true , address=185.167.204.206:4065 , piece_id=4MLUBLNKTWVDZ3X45RGHXWKF3ME5MZ5F2QJCDBFZ4Z5AFZHI2FSA, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: read tcp 188.166.225.170:49906->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:29.980706335 (187h40m26.660901894s) [noise=true , address=185.167.204.206:4054 , piece_id=44FSARDZF4NBHXDYYL3OWQQRJLR7IFXOLFZ2NUPYZW6YBUX2JGEQ, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: read tcp 188.166.225.170:38364->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:29.980738636 (187h40m26.660934205s) [noise=true , address=185.167.204.206:4037 , piece_id=3WOSN5C4XUZ63XQ6YEJ53IPKWAPJWQH4UHFDTQD3LU7L7MNT3QGA, seg_pos={0 0}, upload=165119]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: read tcp 188.166.225.170:40806->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:29.980774294 (187h40m26.660969863s) [seg_pos={0 0}, upload=165119]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil> Sep 6 09:48:30.151706549 (187h40m26.831902118s) [upload=165119]: Done uploading segments... Sep 6 09:48:30.151733431 (187h40m26.831929s) [upload=165119]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8) Duration: 1m0.174267669s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [..............................XXX....X.XX..X................] duration: 12.481376121s target: https://us1.storj.io/login FAIL (2025-09-06 09:48:24 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 12.481400969s core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 21 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXX...XXXXXX...X.X...X.] duration: 8.737735398s FAIL (2025-09-06 09:48:24 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.737760936s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX] duration: 30.000376902s FAIL (2025-09-06 09:48:23 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.000388523s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX] duration: 1m1.411076964s FAIL (2025-09-06 09:48:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== ise=true , address=145.79.227.33:4892 , piece_id=44K24O3K5IR3J6TYVT5D2QZP2DTUSBLBYWSYVJWPHYFFLFGDLHSA, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12RHwFxcUjPsn12uHEAH3fBDJKv1v1tM8mRJXoFrZrG5djdswF5, address:145.79.227.33:4892): protocol: write tcp 188.166.225.170:50588->145.79.227.33:4892: use of closed network connection; write tcp 188.166.225.170:50588->145.79.227.33:4892: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50588->145.79.227.33:4892: use of closed network connection Sep 6 09:48:22.508651012 (187h40m19.188846572s) [noise=true , address=77.90.31.17:4783 , piece_id=KV72PYOBMWCW4LCRSZJWLLFMM4XNNLH57XZS3WHNEVG56FOVPWFQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: write tcp 188.166.225.170:53196->77.90.31.17:4783: use of closed network connection; write tcp 188.166.225.170:53196->77.90.31.17:4783: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53196->77.90.31.17:4783: use of closed network connection Sep 6 09:48:22.508894188 (187h40m19.189089767s) [noise=true , address=145.79.227.12:4796 , piece_id=VZLOSHKR5XXQYSUKWSXOCIMG2YWBXQZKTCX374EXKNNPE4Q7UBJQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12nZwQ4Poz9M14ijFV6qpy5SCWEMeyHQpxN17uSBTH1ts1CFtVS, address:145.79.227.12:4796): protocol: write tcp 188.166.225.170:39384->145.79.227.12:4796: use of closed network connection; write tcp 188.166.225.170:39384->145.79.227.12:4796: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39384->145.79.227.12:4796: use of closed network connection Sep 6 09:48:22.509027974 (187h40m19.189223543s) [noise=true , address=145.79.227.17:4979 , piece_id=4BJKCEEIIDPVH3R6S6K44ORVEAFE47FGTXTB3YDONP6DUTPQQAVQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12mjbYcXw9TCoRMkYNVzDYiT1VxMVnaQzdYxrRsBHD8ghy7GouC, address:145.79.227.17:4979): protocol: write tcp 188.166.225.170:50756->145.79.227.17:4979: use of closed network connection; write tcp 188.166.225.170:50756->145.79.227.17:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50756->145.79.227.17:4979: use of closed network connection Sep 6 09:48:22.509064383 (187h40m19.189259952s) [noise=true , address=145.79.227.14:4842 , piece_id=25NV6OFNXPVJXH5KWWPEW2KUDTT4VBTBPDFIJRSLUHX7RSFC44WQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn, address:145.79.227.14:4842): protocol: write tcp 188.166.225.170:52106->145.79.227.14:4842: use of closed network connection; write tcp 188.166.225.170:52106->145.79.227.14:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52106->145.79.227.14:4842: use of closed network connection Sep 6 09:48:22.509187620 (187h40m19.189383189s) [noise=true , address=145.79.227.4:4195 , piece_id=SH3LNX6UZHZ7A4IHHQB4NICIHESSYIMFFWQCOOAJSDK57WCDB5LQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12mmoBC7kBL5PVuzYvsq8Qb2kFNJNWQBTSCVq6xjkeyJxXPdPBH, address:145.79.227.4:4195): protocol: write tcp 188.166.225.170:52800->145.79.227.4:4195: use of closed network connection; write tcp 188.166.225.170:52800->145.79.227.4:4195: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52800->145.79.227.4:4195: use of closed network connection Sep 6 09:48:22.509309512 (187h40m19.189505071s) [noise=true , address=145.79.227.18:4034 , piece_id=UNKW3UB5HRJC3H7PIGHFKLS2D2XPSKDSO7BIUKH4UREF4AFKIXPA, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY, address:145.79.227.18:4034): protocol: read tcp 188.166.225.170:43078->145.79.227.18:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:22.509343448 (187h40m19.189539017s) [noise=true , address=145.79.227.15:4907 , piece_id=EMMVEEF5I7NREIYNRY6X5US2VODRCPQD3FQXZKSMQJJNRLZ77UFA, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12JNee734A635XWMM3Q3N6siDsvKY3FEMQerDjYZrQR6orGBaY3, address:145.79.227.15:4907): protocol: read tcp 188.166.225.170:56298->145.79.227.15:4907: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:22.509453739 (187h40m19.189649298s) [noise=true , address=77.90.31.16:4760 , piece_id=FSQ4Y7D6C3RZLPV6WII5ADY3UM2NLUZYU6GRR4CTLZQL46JWDHHQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:1e6p1TD5CqUyWdZjkrxh2kRqMuyDiMUr9eimfeayDAKwhtBrZ8, address:77.90.31.16:4760): protocol: write tcp 188.166.225.170:55780->77.90.31.16:4760: use of closed network connection; write tcp 188.166.225.170:55780->77.90.31.16:4760: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55780->77.90.31.16:4760: use of closed network connection Sep 6 09:48:22.509493495 (187h40m19.189689064s) [noise=true , address=145.79.227.33:4870 , piece_id=AP2FARVN6YGX5RCBUSQCPH537JNUQ2XPIV5HEOY7FIV7SFFDOHDA, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: write tcp 188.166.225.170:46828->145.79.227.33:4870: use of closed network connection; write tcp 188.166.225.170:46828->145.79.227.33:4870: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46828->145.79.227.33:4870: use of closed network connection Sep 6 09:48:22.509543170 (187h40m19.189738759s) [noise=true , address=77.90.31.12:4602 , piece_id=W5JIWVMO7GT6QCFYMCRCSDIBWBLZGMZMDC5JSWENFDZSCQZZRPMQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf, address:77.90.31.12:4602): protocol: write tcp 188.166.225.170:49022->77.90.31.12:4602: use of closed network connection; write tcp 188.166.225.170:49022->77.90.31.12:4602: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49022->77.90.31.12:4602: use of closed network connection Sep 6 09:48:22.509666796 (187h40m19.189862365s) [noise=true , address=145.79.227.37:4571 , piece_id=QX5LG2PQ3R7UZFILKXHJFAOBH4L25CAJU7B5PDXTUVCBHIDMFIPQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:1kL49w1XE8S2Dgk9RUfjuXFxisMW3BUEPxPZR87TCVBpAwbyit, address:145.79.227.37:4571): protocol: write tcp 188.166.225.170:56534->145.79.227.37:4571: use of closed network connection; write tcp 188.166.225.170:56534->145.79.227.37:4571: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56534->145.79.227.37:4571: use of closed network connection Sep 6 09:48:22.509703277 (187h40m19.189898846s) [noise=true , address=77.90.31.14:4690 , piece_id=JHX64QU5ZMIFDVDFGSFQ5M7G5M2VVQRZWXMXIM6YFICQVYTUFTPQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:1WPKeCcN1uEhGjZHAJgCoJMaHxAWouGCdaU1vZwAS7kX22rxcv, address:77.90.31.14:4690): protocol: write tcp 188.166.225.170:33170->77.90.31.14:4690: use of closed network connection; write tcp 188.166.225.170:33170->77.90.31.14:4690: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33170->77.90.31.14:4690: use of closed network connection Sep 6 09:48:22.509737872 (187h40m19.189933431s) [noise=true , address=145.79.227.51:4436 , piece_id=IJHIRNGKAHUYICOZHIHJKTDXHCL5ZQIZACTLAT2QOOCWJXWVUHIQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12QrrGrMHYAjyYiTdTXDUy2uH1j2p1qtUVJaDtais2GowJqBPPu, address:145.79.227.51:4436): protocol: write tcp 188.166.225.170:57266->145.79.227.51:4436: use of closed network connection; write tcp 188.166.225.170:57266->145.79.227.51:4436: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57266->145.79.227.51:4436: use of closed network connection Sep 6 09:48:22.509768671 (187h40m19.18996424s) [noise=true , address=145.79.227.3:4182 , piece_id=KTAIGYRIVDFOZC2CJA5XQAJ5ZI2726GJAO6AD56IHCU36XQO75YQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh, address:145.79.227.3:4182): protocol: read tcp 188.166.225.170:53204->145.79.227.3:4182: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:22.509830048 (187h40m19.190025618s) [noise=true , address=145.79.227.47:4270 , piece_id=4MDZKL5GOAOTCRK5WFWASJMK77EBNPFBVZMPS6LPEKK4IDA3GR4Q, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:12sJfMr1nMTpizd5PZ2bZ6M8tZWhFL2ukdJ3cNSRQtdUHNJhg81, address:145.79.227.47:4270): protocol: read tcp 188.166.225.170:60854->145.79.227.47:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:22.509872891 (187h40m19.19006846s) [noise=true , address=145.79.227.31:4823 , piece_id=OZEIZ6UFBKG4T7OSOU35SDCJO6DKHJ6ROQCNJ4RDTNJAJCNYUSBQ, seg_pos={0 0}, upload=165117]: Done uploading piece. err: ecclient: upload failed (node:1fkA5DEj9RqsR6N85z7azvujy8tPkUhB5GCqBpUmFb4vvwbd8y, address:145.79.227.31:4823): protocol: read tcp 188.166.225.170:40754->145.79.227.31:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:22.509887459 (187h40m19.190083028s) [seg_pos={0 0}, upload=165117]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m1.411092874s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 14 out of 60 is failed (threshold=3) [............................X.X.X.X.XX.XXX.X..X...X..X.....X] duration: 30.001147295s FAIL (2025-09-06 09:48:17 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.001174797s core uplink us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 3.864415842s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:48:15 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 3.864441793s edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [..............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.448359536s FAIL (2025-09-06 09:48:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 26]: Uploading piece... Sep 6 09:48:01.370242777 (187h39m58.050438356s) [noise=true , address=45.91.116.4:4937 , piece_id=CK2RG7DUPC6Q62RC4ZQBISRCYNBSUP43INJGD2YCCJRJBJ4E4KAQ, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.370586164 (187h39m58.050781733s) [noise=true , address=45.91.116.8:4047 , piece_id=6HCVHFTDJSKE7N4PRMVCMFRLXFKAL5ENAWCGY73EYEJ75QSTUPMA, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.370883754 (187h39m58.051079333s) [noise=true , address=45.91.116.14:4191 , piece_id=5GILJWOHYA3N5BCL36HLXDA74TFDGIVCC5EXBJEJFWPES7V4G7RA, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.371178787 (187h39m58.051374356s) [noise=true , address=45.91.116.10:4082 , piece_id=R5STJWFZKPE3PX6SQQ3RI4KCTFNQPECVFP6CPYFQ7WNGZ37N4YMQ, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.371441260 (187h39m58.051636839s) [noise=true , address=45.91.116.9:4263 , piece_id=WCPC6KWM4VUPUX2GMMNJHHZ4XZXSGCD5RKWYGMIZCU6JEHQZWZMQ, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.371684195 (187h39m58.051879764s) [noise=true , address=45.91.116.14:4190 , piece_id=7Q7KXTRYXLS4FAKNFRDNGCQ6YWGC6FTO4ICPVFKILYIE6VICT37Q, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.371952549 (187h39m58.052148128s) [noise=true , address=45.91.116.8:4048 , piece_id=UY4BMUKR4LEYFCBFBHR2XGLZRDRVZVKSMM3INUR3WQ37RKRTVCYQ, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.372194412 (187h39m58.052389981s) [noise=true , address=45.91.116.13:4154 , piece_id=N3A7OHTO7OSC3ZWJCONB2PUH4IGRO7YIOIRXEYEA4RT6TK26HV4A, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:01.372533069 (187h39m58.052728648s) [noise=true , address=77.90.31.19:4841 , piece_id=6HZLTMA6TDXBZENXZLNRSQR3YYUKDMJL3QJFB6J3F24BZNHBGWKA, seg_pos={0 0}, upload=165126]: Uploading piece... Sep 6 09:48:14.218516737 (187h40m10.898712316s) [upload=165126]: Next segment err: context deadline exceeded Sep 6 09:48:14.219688989 (187h40m10.899884558s) [noise=true , address=45.91.116.14:4190 , piece_id=7Q7KXTRYXLS4FAKNFRDNGCQ6YWGC6FTO4ICPVFKILYIE6VICT37Q, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:48084->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.219793629 (187h40m10.899989198s) [noise=true , address=45.91.116.13:4154 , piece_id=N3A7OHTO7OSC3ZWJCONB2PUH4IGRO7YIOIRXEYEA4RT6TK26HV4A, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 188.166.225.170:59478->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.219981018 (187h40m10.900176587s) [noise=true , address=45.91.116.11:4118 , piece_id=TA76NN7FH2DBSWYTIN6P4QXEHX3F3RRHTCECKJVXVQRXQOJWYREQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 188.166.225.170:45420->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220043297 (187h40m10.900238876s) [noise=true , address=77.90.31.19:4841 , piece_id=6HZLTMA6TDXBZENXZLNRSQR3YYUKDMJL3QJFB6J3F24BZNHBGWKA, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:59050->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220128170 (187h40m10.900323749s) [noise=true , address=45.91.116.11:4117 , piece_id=LGSDVO7EOR3WLZEHCZ7DLSFZKBCUS5I25ZOCZFJ3YTE4Y2EFBU4Q, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:34318->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220143479 (187h40m10.900339048s) [noise=true , address=45.91.116.12:4226 , piece_id=4FUL2MHWVIUTFHLKS6YTT5HH3JU2XRBZG5VCPB4JS5PCHAKLUAXA, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:58714->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:58714->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58714->45.91.116.12:4226: use of closed network connection Sep 6 09:48:14.220204626 (187h40m10.900400195s) [noise=true , address=77.90.31.14:4663 , piece_id=CBFSIDIJ65O2LFJRFVI26LT5JGWXKETCQPUG652CP4PVGII6TNCQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 188.166.225.170:52328->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220379220 (187h40m10.900574789s) [noise=true , address=77.90.31.10:4519 , piece_id=Z6WAV2K3WJUT4FJF2YAY6HFOQFTKP7PQGZB2XWPOPYRZ7QA5AQRQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 188.166.225.170:34028->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220462910 (187h40m10.900658479s) [noise=true , address=45.91.116.13:4153 , piece_id=7YKVAEJMIPRUPU4N6AVEL2XFMD46S76H754FSUWO2IWSR4CPDYJQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 188.166.225.170:41924->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220511003 (187h40m10.900706572s) [noise=true , address=45.91.116.10:4082 , piece_id=R5STJWFZKPE3PX6SQQ3RI4KCTFNQPECVFP6CPYFQ7WNGZ37N4YMQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: read tcp 188.166.225.170:54558->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220556249 (187h40m10.900751818s) [noise=true , address=45.91.116.8:4047 , piece_id=6HCVHFTDJSKE7N4PRMVCMFRLXFKAL5ENAWCGY73EYEJ75QSTUPMA, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 188.166.225.170:45888->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220597648 (187h40m10.900793217s) [noise=true , address=45.91.116.9:4263 , piece_id=WCPC6KWM4VUPUX2GMMNJHHZ4XZXSGCD5RKWYGMIZCU6JEHQZWZMQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: read tcp 188.166.225.170:58250->45.91.116.9:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220607948 (187h40m10.900803517s) [noise=true , address=45.91.116.4:4937 , piece_id=CK2RG7DUPC6Q62RC4ZQBISRCYNBSUP43INJGD2YCCJRJBJ4E4KAQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: read tcp 188.166.225.170:49076->45.91.116.4:4937: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220649367 (187h40m10.900844936s) [noise=true , address=45.91.116.8:4048 , piece_id=UY4BMUKR4LEYFCBFBHR2XGLZRDRVZVKSMM3INUR3WQ37RKRTVCYQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 188.166.225.170:42308->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220690135 (187h40m10.900885714s) [noise=true , address=45.91.116.14:4191 , piece_id=5GILJWOHYA3N5BCL36HLXDA74TFDGIVCC5EXBJEJFWPES7V4G7RA, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 188.166.225.170:46260->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220718068 (187h40m10.900913637s) [noise=true , address=45.91.116.6:4975 , piece_id=OOJV4UJNFFLJVHZKEUOKQQOQCI4YTSWTN6ATWTR7V7VZB53A6YXQ, seg_pos={0 0}, upload=165126]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 188.166.225.170:44728->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:48:14.220746753 (187h40m10.900942332s) [seg_pos={0 0}, upload=165126]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.448381028s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.001012508s FAIL (2025-09-06 09:48:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001023858s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X.........................X....X] duration: 30.021746012s FAIL (2025-09-06 09:48:05 UTC) operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 48) Duration: 30.021768404s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 8 out of 60 is failed (threshold=3) [............................X..X....X.X........X.X....X..X..] duration: 6.520134483s FAIL (2025-09-06 09:47:59 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 45) Duration: 6.52015951s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [...............................XXX....X.XX..X...............] duration: 1.842572765s target: https://us1.storj.io/login FAIL (2025-09-06 09:47:56 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 1.842600848s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX] duration: 1m2.319743005s FAIL (2025-09-06 09:47:52 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 48) Duration: 1m2.319760137s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 12 out of 60 is failed (threshold=3) [....................................XX...XX....XXXX..XX..XX.] duration: 17.411186161s FAIL (2025-09-06 09:47:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload Sep 6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload Sep 6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments... Sep 6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true Sep 6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments... Sep 6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments... Sep 6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil> Duration:* 17.411201601s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 21 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXX...XXXXXX...X.X...X] duration: 30.000518537s FAIL (2025-09-06 09:47:50 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000538626s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 7 out of 60 is failed (threshold=3) [......................................X..X..X..X.X.....X.X..] duration: 2.924404363s FAIL (2025-09-06 09:47:42 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 2.924428058s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [...........................XXXXXX.....XXX.X.X.XXXX.......X..] duration: 16.16838835s FAIL (2025-09-06 09:47:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:46.366247849 (187h38m43.046443428s) [upload=165109]: Starting upload Sep 6 09:46:46.366460015 (187h38m43.046655584s) [upload=165109]: Done starting upload Sep 6 09:46:46.366547202 (187h38m43.046742781s) [upload=165109]: Uploading segments... Sep 6 09:46:46.366646412 (187h38m43.046841981s) [upload=165109]: Got next segment. Inline: true Sep 6 09:46:46.366654808 (187h38m43.046850377s) [upload=165109]: Waiting for error group managing segments... Sep 6 09:46:46.366705084 (187h38m43.046900663s) [upload=165109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:46.366710925 (187h38m43.046906494s) [upload=165109]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:46.366714111 (187h38m43.04690968s) [upload=165109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:46:48.432670089 (187h38m45.112865658s) [upload=165109]: Done uploading segments... Sep 6 09:46:48.432690096 (187h38m45.112885665s) [upload=165109]: Upload finished. err: <nil> Duration:* 16.168417878s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 12 out of 60 is failed (threshold=3) [.....................................XX...XX....XXXX..XX..XX] duration: 1m0.000614297s FAIL (2025-09-06 09:47:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:39.955557621 (187h38m36.63575321s) [upload=165105]: Starting upload Sep 6 09:46:39.955655348 (187h38m36.635850917s) [upload=165105]: Done starting upload Sep 6 09:46:39.955726043 (187h38m36.635921612s) [upload=165105]: Uploading segments... Sep 6 09:46:39.955775858 (187h38m36.635971457s) [upload=165105]: Got next segment. Inline: true Sep 6 09:46:39.955781890 (187h38m36.635977489s) [upload=165105]: Waiting for error group managing segments... Sep 6 09:46:39.955831334 (187h38m36.636026914s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:39.955837576 (187h38m36.636033165s) [upload=165105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:39.955842506 (187h38m36.636038106s) [upload=165105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:47:07.270828711 (187h39m3.95102428s) [upload=165105]: Done uploading segments... Sep 6 09:47:07.270847417 (187h39m3.951042986s) [upload=165105]: Upload finished. err: <nil> Duration:* 1m0.000623785s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.180984s FAIL (2025-09-06 09:47:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 8) ======LOGS====== iece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:47:29.536552757 (187h39m26.216748326s) [noise=true , address=81.171.14.70:4037 , piece_id=BHESRFBJ5UOAMK7Z6BQSUUCPISTB3QUVNKPF2B6EVTFGKDA5TSRQ, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:52846->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:52846->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52846->81.171.14.70:4037: use of closed network connection Sep 6 09:47:29.536687856 (187h39m26.216883425s) [noise=true , address=81.171.14.70:4035 , piece_id=WXBHUNPGOXNAVOEOWKRLO5HGO2XJFW3YD6GGIUMIIC2YGHU5WWTA, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:36960->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:36960->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36960->81.171.14.70:4035: use of closed network connection Sep 6 09:47:29.536781294 (187h39m26.216976863s) [noise=true , address=185.167.204.205:4007 , piece_id=XESHNLFNMTC6UGMTMZBDKP2OWQI6EXOITV7SNIBJVVHYXXFQQJDQ, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:12m7e6EGQBC1wvbRQ5uwG8wuHbgZeyXPdj5XDMi1kgo5woPgXR, address:185.167.204.205:4007): protocol: write tcp 188.166.225.170:41586->185.167.204.205:4007: use of closed network connection; write tcp 188.166.225.170:41586->185.167.204.205:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41586->185.167.204.205:4007: use of closed network connection Sep 6 09:47:29.536880254 (187h39m26.217075823s) [noise=true , address=81.171.14.70:4041 , piece_id=VGAFOUHZ3M2BDKZT6OSE3IM45ZWLAKAWFCKR6DWYGDW67YUIYSUQ, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:36790->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:36790->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36790->81.171.14.70:4041: use of closed network connection Sep 6 09:47:29.536915892 (187h39m26.217111461s) [noise=true , address=185.167.204.205:4017 , piece_id=LQSBSCFXAJZU6IR24K6FJB33DD4LHQJFDC2376UATQ6AMXECRCPQ, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: write tcp 188.166.225.170:52334->185.167.204.205:4017: use of closed network connection; write tcp 188.166.225.170:52334->185.167.204.205:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52334->185.167.204.205:4017: use of closed network connection Sep 6 09:47:29.537108460 (187h39m26.217304029s) [noise=true , address=81.171.14.70:4025 , piece_id=TYQZSQWVMCZAPG2ALF6H3PGCJZWGOIGP45U2QHY5J5A42ILORCHQ, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:37206->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:37206->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37206->81.171.14.70:4025: use of closed network connection Sep 6 09:47:29.537143537 (187h39m26.217339106s) [noise=true , address=185.167.204.205:4013 , piece_id=FYWUUBKENXWVYBQWAEEAHFOLFTGQYTZIB6MMNW7ZBRPIQELS4GVA, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: read tcp 188.166.225.170:41814->185.167.204.205:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:29.537176890 (187h39m26.21737246s) [noise=true , address=185.167.204.206:4048 , piece_id=SEDQLQSET26UKU76BGWHKJCNTHFHO5YUMQY7BN2CTHR64T66I57A, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: read tcp 188.166.225.170:39022->185.167.204.206:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:29.537204423 (187h39m26.217399992s) [noise=true , address=185.167.204.206:4046 , piece_id=URWBBEQCLJ7XCKZJGBVVXQ32B53KDJJLRWSIAKR7TUBCRE4EBB3A, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: read tcp 188.166.225.170:40244->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:29.537240473 (187h39m26.217436042s) [noise=true , address=185.167.204.206:4066 , piece_id=ODEOKMZVOEIKNEQCPK43SG2UCAJ4435K4XODYTQ7LRI4X4VZX2KQ, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 188.166.225.170:36602->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:29.537389107 (187h39m26.217584676s) [noise=true , address=81.171.14.70:4028 , piece_id=BXLHCSWERRIYV6K6WZTKTBL5JOX5WAJQAIB4V2RDP4QSQDF632LQ, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:59700->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:59700->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59700->81.171.14.70:4028: use of closed network connection Sep 6 09:47:29.537427611 (187h39m26.21762318s) [noise=true , address=185.167.204.206:4057 , piece_id=3JAQHJBPGYYJUEIX7RORM2SQABBDGZXRKLG3PSMFQM4QT2WXM6JA, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: write tcp 188.166.225.170:60466->185.167.204.206:4057: use of closed network connection; write tcp 188.166.225.170:60466->185.167.204.206:4057: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60466->185.167.204.206:4057: use of closed network connection Sep 6 09:47:29.537457548 (187h39m26.217653117s) [noise=true , address=185.167.204.206:4055 , piece_id=OVHPR2LBPLO2ESAG6QFOWAUHUGM27RGFDB5ZIJYH7Y6KZIZS5EYA, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: write tcp 188.166.225.170:43866->185.167.204.206:4055: use of closed network connection; write tcp 188.166.225.170:43866->185.167.204.206:4055: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43866->185.167.204.206:4055: use of closed network connection Sep 6 09:47:29.537502654 (187h39m26.217698213s) [noise=true , address=185.167.204.206:4072 , piece_id=7I6O6RVSSNBDETWZXP477UIZWTRPEPBGUBRNE6OVRHNNVPJGOAGA, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 188.166.225.170:45334->185.167.204.206:4072: use of closed network connection; write tcp 188.166.225.170:45334->185.167.204.206:4072: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45334->185.167.204.206:4072: use of closed network connection Sep 6 09:47:29.537523594 (187h39m26.217719163s) [noise=true , address=81.171.14.70:4027 , piece_id=OTDYAPGS3GLVFAVVVRV6AW3TJCT6CBYRE5XVBK7FRIY2VA7CEOBA, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 188.166.225.170:52542->81.171.14.70:4027: use of closed network connection; write tcp 188.166.225.170:52542->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52542->81.171.14.70:4027: use of closed network connection Sep 6 09:47:29.537635979 (187h39m26.217831548s) [noise=true , address=81.171.14.70:4030 , piece_id=36OLB3QMF65ATEKLMVTFXV45LQCE5RIWK2QDSMFQ5VEVJQ7MBO5A, seg_pos={0 0}, upload=165104]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:41224->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:41224->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: context deadline exceeded Sep 6 09:47:29.537652742 (187h39m26.217848301s) [seg_pos={0 0}, upload=165104]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil> Sep 6 09:47:29.715122217 (187h39m26.395317786s) [upload=165104]: Done uploading segments... Sep 6 09:47:29.715147265 (187h39m26.395342834s) [upload=165104]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8) Duration: 1m0.181009129s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 31 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 11.263885841s FAIL (2025-09-06 09:47:28 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": unexpected EOF Duration: 11.263910156s edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [................................XXX....X.XX..X..............] duration: 22.353677139s target: https://us1.storj.io/login FAIL (2025-09-06 09:47:26 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 22.353705072s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [.............................X.X.X.X.XX.XXX.X..X...X..X.....] duration: 26.593047341s FAIL (2025-09-06 09:47:23 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 26.593082698s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX] duration: 1m1.498304731s FAIL (2025-09-06 09:47:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== store: piecestore close: write tcp 188.166.225.170:38984->77.90.31.14:4689: use of closed network connection Sep 6 09:47:20.765468341 (187h39m17.44566391s) [noise=true , address=45.91.116.11:4150 , piece_id=EEZGQLMIDXGOVJOQDOEPONPAQM2EVKTI63PJWU6DG2RAIOCX36SA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ, address:45.91.116.11:4150): protocol: write tcp 188.166.225.170:32966->45.91.116.11:4150: use of closed network connection; write tcp 188.166.225.170:32966->45.91.116.11:4150: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32966->45.91.116.11:4150: use of closed network connection Sep 6 09:47:20.765582068 (187h39m17.445777637s) [noise=true , address=77.90.31.13:4652 , piece_id=IMUUZ42ASNJ5PCFSMH7KAACFI7LXWOVTBSODXQHURRARFKZYH6AA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:12KrMw5DoiMSiBHMZJ8Zf8ir7UnTzBwUt9XMhw3Ria6ASGkm3FA, address:77.90.31.13:4652): protocol: write tcp 188.166.225.170:44762->77.90.31.13:4652: use of closed network connection; write tcp 188.166.225.170:44762->77.90.31.13:4652: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44762->77.90.31.13:4652: use of closed network connection Sep 6 09:47:20.765620342 (187h39m17.445815901s) [noise=true , address=145.79.227.37:4587 , piece_id=PAIMCSDIEZM2HC3QX6JAWL3DEHUQWE57PIKXP5CJZZBF5YYBZWHA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:126wqKRVvj3engw69RJSmdgdB91qMyG1Ed5XfUCpu3ZGq3uXSbe, address:145.79.227.37:4587): protocol: write tcp 188.166.225.170:46942->145.79.227.37:4587: use of closed network connection; write tcp 188.166.225.170:46942->145.79.227.37:4587: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46942->145.79.227.37:4587: use of closed network connection Sep 6 09:47:20.765656281 (187h39m17.44585185s) [noise=true , address=45.91.116.10:4114 , piece_id=6YNNM4MEJDOAFGWMR6S3FLE7IH7UBDLDBS3HV6OBD7ANILTBWXNA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:121wUjWPiPFgX5PLRcNrs535zEL81fbPpquD9rhSaqkpWxjGZLY, address:45.91.116.10:4114): protocol: read tcp 188.166.225.170:35840->45.91.116.10:4114: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:20.765688612 (187h39m17.445884171s) [noise=true , address=77.90.31.12:4598 , piece_id=5Z3QMGJYD7MF7MZFCHZXTREP52ELOK2RPGISJ3KL3GG5SEXT7GTA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:12Li7UVDCVmainU4mkxtFyGky2wi6989Qu12BCQGgNn6roNX2A3, address:77.90.31.12:4598): protocol: write tcp 188.166.225.170:60002->77.90.31.12:4598: use of closed network connection; write tcp 188.166.225.170:60002->77.90.31.12:4598: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60002->77.90.31.12:4598: use of closed network connection Sep 6 09:47:20.765775889 (187h39m17.445971458s) [noise=true , address=77.90.31.17:4802 , piece_id=6HWMAHEH2CLOXTGVOSKIZ27AVSX5M3A63ABUXIQWCWTEUSVECGVQ, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:12hiNtWkLwWMYr8rPN9ukEKQou5Eko2fD9ScXsqBKk5oX5wxgHy, address:77.90.31.17:4802): protocol: write tcp 188.166.225.170:47460->77.90.31.17:4802: use of closed network connection; write tcp 188.166.225.170:47460->77.90.31.17:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47460->77.90.31.17:4802: use of closed network connection Sep 6 09:47:20.765983497 (187h39m17.446179066s) [noise=true , address=145.79.227.49:4343 , piece_id=LMORSDLR5PMA2PPVTOAIDAMDRSKLXYNPF3UN2YWOH7YVFB4AXN3Q, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: write tcp 188.166.225.170:58666->145.79.227.49:4343: use of closed network connection; write tcp 188.166.225.170:58666->145.79.227.49:4343: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58666->145.79.227.49:4343: use of closed network connection Sep 6 09:47:20.766047890 (187h39m17.446243449s) [noise=true , address=145.79.227.14:4851 , piece_id=SUR62RKH4D6GRR6BG7BKI2IHPOTFWSXVQMX27FRCW5GJ2RR26MAQ, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R, address:145.79.227.14:4851): protocol: write tcp 188.166.225.170:57766->145.79.227.14:4851: use of closed network connection; write tcp 188.166.225.170:57766->145.79.227.14:4851: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57766->145.79.227.14:4851: use of closed network connection Sep 6 09:47:20.766087666 (187h39m17.446283235s) [noise=true , address=145.79.227.3:4184 , piece_id=KV2CF3HQVT3BZR6MDNVS2NLFWMKUYXA4MK3NUNJTU5V6OSL6LBQQ, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls, address:145.79.227.3:4184): protocol: write tcp 188.166.225.170:42320->145.79.227.3:4184: use of closed network connection; write tcp 188.166.225.170:42320->145.79.227.3:4184: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42320->145.79.227.3:4184: use of closed network connection Sep 6 09:47:20.766122603 (187h39m17.446318172s) [noise=true , address=145.79.227.28:4749 , piece_id=SCGK4VR7EHPORPLPKDYP73IZ22SIDNMWCM3HVXWW3COAR4CINCLQ, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:1CKpmdJXXJVjy5PYy8N82gquvqGPaaLE3Qxz2pTAbTUPnpBZCi, address:145.79.227.28:4749): protocol: write tcp 188.166.225.170:45598->145.79.227.28:4749: use of closed network connection; write tcp 188.166.225.170:45598->145.79.227.28:4749: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->145.79.227.28:4749: use of closed network connection Sep 6 09:47:20.766244526 (187h39m17.446440095s) [noise=true , address=77.90.31.16:4767 , piece_id=KVYPYS2PNZHLGU3LEVDK4XPIEM4OO7HUP43EERPPYZZFUR2H5X2A, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK, address:77.90.31.16:4767): protocol: write tcp 188.166.225.170:38310->77.90.31.16:4767: use of closed network connection; write tcp 188.166.225.170:38310->77.90.31.16:4767: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38310->77.90.31.16:4767: use of closed network connection Sep 6 09:47:20.766270876 (187h39m17.446466435s) [noise=true , address=77.90.31.10:4521 , piece_id=LKFCDJLZTGWGMRDOIJWXCWX23CQAI46D2WMYNB4Y2CRHEF7PMXKQ, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:1WpVJa7SXkANKParDWYrC1cN8aLHTkUSPrRJGKQ6fvA5oDEkoa, address:77.90.31.10:4521): protocol: write tcp 188.166.225.170:39294->77.90.31.10:4521: use of closed network connection; write tcp 188.166.225.170:39294->77.90.31.10:4521: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39294->77.90.31.10:4521: use of closed network connection Sep 6 09:47:20.766287699 (187h39m17.446483268s) [noise=true , address=45.91.116.5:4321 , piece_id=I7YZOP6PU6NTC35AO5Z5GKMUTT5CCLSBFGLMZCAXGX7DKEOLGYUA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj, address:45.91.116.5:4321): protocol: read tcp 188.166.225.170:54678->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:20.766410153 (187h39m17.446605722s) [noise=true , address=145.79.227.19:4098 , piece_id=VV7DA5ERIA7IBABHG5R4YVJNBWKTAMEBWFSBUYCKTPCJFF7YPP2A, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY, address:145.79.227.19:4098): protocol: read tcp 188.166.225.170:33118->145.79.227.19:4098: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:20.766430582 (187h39m17.446626151s) [noise=true , address=145.79.227.15:4889 , piece_id=BLXXZVCRM4VFA3TT5AZUD5IUEYUOOPNDVTEQLU6GDIVFFFTLYIBQ, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:12bHiSJdKfh52F8nikVXN1R5HJCpggLCpqVYAhsV9NaNQhtAntc, address:145.79.227.15:4889): protocol: read tcp 188.166.225.170:42840->145.79.227.15:4889: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:20.766452955 (187h39m17.446648524s) [noise=true , address=145.79.227.17:4998 , piece_id=TP242BEJTHUVWKYEHTUUFH4PRLSRSJAC5RUF7IBOWMJZPM2SEGXA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:12m8BAEezShMZxBdiwdLhUD6FVbQfDdaFmNDkdM1mKC4WYsidMR, address:145.79.227.17:4998): protocol: read tcp 188.166.225.170:50072->145.79.227.17:4998: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:20.766473254 (187h39m17.446668813s) [noise=true , address=77.90.31.15:4714 , piece_id=G6SMPQHAVEO2IPMYPDHC5IGYFJ6MCGKXNZXYU6HSGEUIWEQY62CA, seg_pos={0 0}, upload=165108]: Done uploading piece. err: ecclient: upload failed (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP, address:77.90.31.15:4714): protocol: read tcp 188.166.225.170:33702->77.90.31.15:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:47:20.766503582 (187h39m17.446699151s) [seg_pos={0 0}, upload=165108]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m1.498317416s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.928871342s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:47:20 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 2.928896551s edge linksharing us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.........................X....] duration: 4.143589503s FAIL (2025-09-06 09:47:18 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 4.143615162s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [............................XXXXXX.....XXX.X.X.XXXX.......X.] duration: 10.858045333s FAIL (2025-09-06 09:47:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:46.366247849 (187h38m43.046443428s) [upload=165109]: Starting upload Sep 6 09:46:46.366460015 (187h38m43.046655584s) [upload=165109]: Done starting upload Sep 6 09:46:46.366547202 (187h38m43.046742781s) [upload=165109]: Uploading segments... Sep 6 09:46:46.366646412 (187h38m43.046841981s) [upload=165109]: Got next segment. Inline: true Sep 6 09:46:46.366654808 (187h38m43.046850377s) [upload=165109]: Waiting for error group managing segments... Sep 6 09:46:46.366705084 (187h38m43.046900663s) [upload=165109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:46.366710925 (187h38m43.046906494s) [upload=165109]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:46.366714111 (187h38m43.04690968s) [upload=165109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:46:48.432670089 (187h38m45.112865658s) [upload=165109]: Done uploading segments... Sep 6 09:46:48.432690096 (187h38m45.112885665s) [upload=165109]: Upload finished. err: <nil> Duration:* 10.858058819s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.000644153s FAIL (2025-09-06 09:47:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000656999s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 20 out of 60 is failed (threshold=3) [..............................XXXXXXXXXXXX...XXXXXX...X.X...] duration: 18.655332797s FAIL (2025-09-06 09:47:06 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 18.655353596s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.0010758s FAIL (2025-09-06 09:47:03 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 30.001088333s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [.............................XXXXXX.....XXX.X.X.XXXX.......X] duration: 30.001548224s FAIL (2025-09-06 09:47:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:46.366247849 (187h38m43.046443428s) [upload=165109]: Starting upload Sep 6 09:46:46.366460015 (187h38m43.046655584s) [upload=165109]: Done starting upload Sep 6 09:46:46.366547202 (187h38m43.046742781s) [upload=165109]: Uploading segments... Sep 6 09:46:46.366646412 (187h38m43.046841981s) [upload=165109]: Got next segment. Inline: true Sep 6 09:46:46.366654808 (187h38m43.046850377s) [upload=165109]: Waiting for error group managing segments... Sep 6 09:46:46.366705084 (187h38m43.046900663s) [upload=165109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:46.366710925 (187h38m43.046906494s) [upload=165109]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:46.366714111 (187h38m43.04690968s) [upload=165109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:46:48.432670089 (187h38m45.112865658s) [upload=165109]: Done uploading segments... Sep 6 09:46:48.432690096 (187h38m45.112885665s) [upload=165109]: Upload finished. err: <nil> Duration:* 30.001570056s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.............................X..X....X.X........X.X....X..X.] duration: 5.52165287s FAIL (2025-09-06 09:47:01 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 45) Duration: 5.521684822s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 7 out of 60 is failed (threshold=3) [.......................................X..X..X..X.X.....X.X.] duration: 11.715892543s FAIL (2025-09-06 09:46:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 11.715943139s edge authservice http us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)