Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration: 30.002844759s FAIL (2025-09-06 09:46:50 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.002859317s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [..........................................X.X..X.XX.........] duration: 11.876039929s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:46:45 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 11.876061019s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.........................X...] duration: 4.03984349s FAIL (2025-09-06 09:46:44 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 4.039871594s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [..............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.001091405s FAIL (2025-09-06 09:46:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001216676s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 8 out of 60 is failed (threshold=3) [..............................X..X....X.X........X.X....X..X] duration: 30.188988886s FAIL (2025-09-06 09:46:37 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 45) Duration: 30.189009687s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 11 out of 60 is failed (threshold=3) [......................................XX...XX....XXXX..XX..X] duration: 1m0.001113982s FAIL (2025-09-06 09:46:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:46:14.666017115 (187h38m11.346212685s) [upload=165101]: Starting upload Sep 6 09:46:14.666107468 (187h38m11.346303047s) [upload=165101]: Done starting upload Sep 6 09:46:14.666170209 (187h38m11.346365778s) [upload=165101]: Uploading segments... Sep 6 09:46:14.666249470 (187h38m11.346445039s) [upload=165101]: Got next segment. Inline: true Sep 6 09:46:14.666254350 (187h38m11.346449919s) [upload=165101]: Waiting for error group managing segments... Sep 6 09:46:14.666358238 (187h38m11.346553807s) [upload=165101]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:46:14.666363479 (187h38m11.346559048s) [upload=165101]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:46:14.666366103 (187h38m11.346561673s) [upload=165101]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:46:33.253790056 (187h38m29.933985625s) [upload=165101]: Done uploading segments... Sep 6 09:46:33.253835944 (187h38m29.934031513s) [upload=165101]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1m0.001123989s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m1.586858217s FAIL (2025-09-06 09:46:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== pload=165093]: Uploading piece... Sep 6 09:45:43.702678447 (187h37m40.382874036s) [noise=true , address=45.91.116.7:4011 , piece_id=5AHTTUKW6UKOLWMTU7QX3VFSO3II3UBHXL3ZDGL23277ADKPHDNQ, seg_pos={0 0}, upload=165093]: Uploading piece... Sep 6 09:45:43.702787686 (187h37m40.382983255s) [noise=true , address=45.91.116.8:4048 , piece_id=L2K7ISLWBYFNW3LA2YCB24BAIUJP2DM6FM3ELAU3MCGGC33G7DVQ, seg_pos={0 0}, upload=165093]: Uploading piece... Sep 6 09:45:43.703053404 (187h37m40.383248973s) [noise=true , address=77.90.31.15:4698 , piece_id=FWRJDVCNT5QYRZJIJAOTNGQEZLJNDT4RSB5Q5L4M7A4B6S5GO5BQ, seg_pos={0 0}, upload=165093]: Uploading piece... Sep 6 09:45:43.703344892 (187h37m40.383540471s) [noise=true , address=45.91.116.4:4940 , piece_id=4ISIF4L2HDSJAXT3UBI5VIUJZ372EMHERIM3ZOZCGBRQHBU2DUPA, seg_pos={0 0}, upload=165093]: Uploading piece... Sep 6 09:45:43.704312243 (187h37m40.384507812s) [noise=true , address=45.91.116.4:4938 , piece_id=U4GN34N25OC437OMHJLYKTGBC56WU7AOD7EKMIDS3X2FGDLXLHRA, seg_pos={0 0}, upload=165093]: Uploading piece... Sep 6 09:45:43.704537655 (187h37m40.384733234s) [noise=true , address=45.91.116.13:4155 , piece_id=J76EK7PPYDP7AP47WNESULV2E7LAAMEABEQSVFPGO2E3G5QNWW6Q, seg_pos={0 0}, upload=165093]: Uploading piece... Sep 6 09:45:43.704612367 (187h37m40.384807936s) [noise=true , address=77.90.31.19:4842 , piece_id=XWJBU6MGI6K3VK23365GHGXA4IVV2BBWDG53YEFJ3IGSJUFSAGQQ, seg_pos={0 0}, upload=165093]: Uploading piece... Sep 6 09:46:01.260959747 (187h37m57.941155317s) [noise=true , address=45.91.116.10:4081 , piece_id=D3ZXJ5ENZ3S2PPSEAIDUXYZWENNSGS5GZ3OZXWUAXI35H2H2ZSMQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:59072->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:59072->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59072->45.91.116.10:4081: use of closed network connection Sep 6 09:46:01.261189217 (187h37m57.941384786s) [noise=true , address=77.90.31.17:4770 , piece_id=YNVEHSLNEV66VKFGTE6B56RCL3BZP5PQL2UUYDNBDFKCEKLW2OUA, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:57218->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:57218->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57218->77.90.31.17:4770: use of closed network connection Sep 6 09:46:01.261221369 (187h37m57.941416938s) [upload=165093]: Next segment err: context deadline exceeded Sep 6 09:46:01.261265794 (187h37m57.941461363s) [noise=true , address=45.91.116.9:4261 , piece_id=BKSMOLW7MOQFIFVD7YSWJUKA6NZC5BWQ2N2WURNWGPWZZILGIRCQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: read tcp 188.166.225.170:59722->45.91.116.9:4261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261323334 (187h37m57.941519204s) [noise=true , address=45.91.116.7:4011 , piece_id=5AHTTUKW6UKOLWMTU7QX3VFSO3II3UBHXL3ZDGL23277ADKPHDNQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:53146->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261367438 (187h37m57.941563007s) [noise=true , address=45.91.116.9:4262 , piece_id=ZDAEQCLTS26DFYKMZIQ7357JRETJOG2YJBQ7YTIUIDZ45OCTFTNA, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 188.166.225.170:47904->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261539668 (187h37m57.941735237s) [noise=true , address=45.91.116.6:4974 , piece_id=ROWYKXHLEA7FGXQHB55EBEJKQST2AID4FCYCEWTI6YYUCQBLWUIQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: read tcp 188.166.225.170:56526->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261582720 (187h37m57.941778289s) [noise=true , address=45.91.116.4:4940 , piece_id=4ISIF4L2HDSJAXT3UBI5VIUJZ372EMHERIM3ZOZCGBRQHBU2DUPA, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: read tcp 188.166.225.170:57850->45.91.116.4:4940: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261614801 (187h37m57.94181037s) [noise=true , address=77.90.31.12:4589 , piece_id=SBCZTIJIBWIBTJ5CLFEVRFGZZTAWOIKD5V32GQDAW2XL5QRHMNQA, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 188.166.225.170:49050->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261670327 (187h37m57.941865896s) [noise=true , address=45.91.116.8:4048 , piece_id=L2K7ISLWBYFNW3LA2YCB24BAIUJP2DM6FM3ELAU3MCGGC33G7DVQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 188.166.225.170:59830->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261740211 (187h37m57.94193578s) [noise=true , address=77.90.31.19:4842 , piece_id=XWJBU6MGI6K3VK23365GHGXA4IVV2BBWDG53YEFJ3IGSJUFSAGQQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:52814->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261789436 (187h37m57.941985005s) [noise=true , address=45.91.116.13:4154 , piece_id=IVKPR7OKVJUVWUCNFNE5OJKYAAW3KUBMDQQY6T4HZCAF7L42C65Q, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: read tcp 188.166.225.170:42804->45.91.116.13:4154: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261873997 (187h37m57.942069577s) [noise=true , address=45.91.116.5:4299 , piece_id=R5JNZHA653LQ2CHFKAJDXYFVVP3NFCCRX2GMMAK4IDKLT2J5EZ4Q, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 188.166.225.170:45016->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.261943550 (187h37m57.942139119s) [noise=true , address=77.90.31.15:4698 , piece_id=FWRJDVCNT5QYRZJIJAOTNGQEZLJNDT4RSB5Q5L4M7A4B6S5GO5BQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: read tcp 188.166.225.170:58242->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.262014105 (187h37m57.942209715s) [noise=true , address=45.91.116.4:4938 , piece_id=U4GN34N25OC437OMHJLYKTGBC56WU7AOD7EKMIDS3X2FGDLXLHRA, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:46236->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:46236->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46236->45.91.116.4:4938: use of closed network connection Sep 6 09:46:01.262049994 (187h37m57.942245563s) [noise=true , address=45.91.116.13:4155 , piece_id=J76EK7PPYDP7AP47WNESULV2E7LAAMEABEQSVFPGO2E3G5QNWW6Q, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 188.166.225.170:43248->45.91.116.13:4155: use of closed network connection; write tcp 188.166.225.170:43248->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43248->45.91.116.13:4155: use of closed network connection Sep 6 09:46:01.262111683 (187h37m57.942307252s) [noise=true , address=77.90.31.13:4628 , piece_id=2IDOFUERVFDSU6F37M2BPRBENEJX3UKIVT7FIYJFXTITDNVFUYRQ, seg_pos={0 0}, upload=165093]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 188.166.225.170:42476->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:01.262143914 (187h37m57.942339483s) [seg_pos={0 0}, upload=165093]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 1m1.586880007s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 7 out of 60 is failed (threshold=3) [........................................X..X..X..X.X.....X.X] duration: 30.001439323s FAIL (2025-09-06 09:46:31 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 30.001582568s edge authservice http us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration: 1m0.17714833s FAIL (2025-09-06 09:46:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 5) ======LOGS====== KVWZVXZZYSDH3D7CWIQ, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 188.166.225.170:59510->185.167.204.206:4062: use of closed network connection; write tcp 188.166.225.170:59510->185.167.204.206:4062: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59510->185.167.204.206:4062: use of closed network connection Sep 6 09:46:28.763022717 (187h38m25.443218287s) [noise=true , address=185.167.204.205:4034 , piece_id=4X7IILKQWTM2IMOJWF35HV4YR2F3VZC7Y5I6M73OTYJIUV5NUDQA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: write tcp 188.166.225.170:47436->185.167.204.205:4034: use of closed network connection; write tcp 188.166.225.170:47436->185.167.204.205:4034: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47436->185.167.204.205:4034: use of closed network connection Sep 6 09:46:28.763056452 (187h38m25.443252011s) [noise=true , address=81.171.14.70:4039 , piece_id=WGAM22MPR7TSRGIRLFAQDQSP7XYMXFKBQYLWCAO4LRUTJWQFOYQQ, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:53818->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:53818->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53818->81.171.14.70:4039: use of closed network connection Sep 6 09:46:28.763064807 (187h38m25.443260377s) [noise=true , address=81.171.14.70:4035 , piece_id=RK7TL34566KXMN3FFITZ34YJPJK2VSDROVBV5GOMZXMRLSQR6MMQ, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:34732->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:34732->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34732->81.171.14.70:4035: use of closed network connection Sep 6 09:46:28.763096839 (187h38m25.443292408s) [noise=true , address=81.171.14.70:4029 , piece_id=FMJ4QMPODL7J4FSMN6LYX7SHFOK5ERWCJCEUIQ7LRABUNAMU3ISA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:57202->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:57202->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57202->81.171.14.70:4029: use of closed network connection Sep 6 09:46:28.763167264 (187h38m25.443362833s) [noise=true , address=185.167.204.206:4072 , piece_id=LFHDDJBLDLQG7SSQSP4IS7SB5UK34PZTEDY5H73LWHQS6HIE64RA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 188.166.225.170:34646->185.167.204.206:4072: use of closed network connection; write tcp 188.166.225.170:34646->185.167.204.206:4072: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34646->185.167.204.206:4072: use of closed network connection Sep 6 09:46:28.763209294 (187h38m25.443404863s) [noise=true , address=81.171.14.70:4040 , piece_id=SCRV7ULHMUQUT6DFBMPG4V25RAJOU2ZPVJWND5CA35G4QT6HMQUA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 188.166.225.170:56082->81.171.14.70:4040: use of closed network connection; write tcp 188.166.225.170:56082->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56082->81.171.14.70:4040: use of closed network connection Sep 6 09:46:28.763239952 (187h38m25.443435521s) [noise=true , address=81.171.14.70:4030 , piece_id=AKTH4LA3WQ7VYQY7IHJELRMIOZHQRV6DQXKXVH7HDMFVEL4ZQSBA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:38140->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:38140->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38140->81.171.14.70:4030: use of closed network connection Sep 6 09:46:28.763272155 (187h38m25.443467724s) [noise=true , address=81.171.14.70:4048 , piece_id=VB3BAQIBXJAGGGJIA4IX5XHNKLT3E5MWKCTNIT56L5PZYD2AJREA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: write tcp 188.166.225.170:37880->81.171.14.70:4048: use of closed network connection; write tcp 188.166.225.170:37880->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37880->81.171.14.70:4048: use of closed network connection Sep 6 09:46:28.763314445 (187h38m25.443510014s) [noise=true , address=81.171.14.70:4046 , piece_id=6N7DHHLO4QIHTDBAEMGU3YBHW5UDQOJ3DSTJECTSS5NB2TYAXE7Q, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:60782->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:60782->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60782->81.171.14.70:4046: use of closed network connection Sep 6 09:46:28.763350795 (187h38m25.443546364s) [noise=true , address=185.167.204.205:4017 , piece_id=DUC7CHQLN3H3S4NFITN5VQNHZ53A4K74HLJ734RJ4QVH73FV6Q7A, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: write tcp 188.166.225.170:52878->185.167.204.205:4017: use of closed network connection; write tcp 188.166.225.170:52878->185.167.204.205:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52878->185.167.204.205:4017: use of closed network connection Sep 6 09:46:28.763390761 (187h38m25.44358633s) [noise=true , address=81.171.14.70:4047 , piece_id=2HLVIUQLOR5UNPNTOFRN52VCWT32G6GDXE3EJSKGGWWOEAFI6JZA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:42494->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:42494->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42494->81.171.14.70:4047: use of closed network connection Sep 6 09:46:28.763412243 (187h38m25.443607812s) [noise=true , address=81.171.14.70:4038 , piece_id=PJSYANBY47C4PEXYLFQZFVJFXWULRHP6CJM2H5BWXOILY2PJZ5IQ, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48132->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48132->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48132->81.171.14.70:4038: use of closed network connection Sep 6 09:46:28.763428744 (187h38m25.443624313s) [noise=true , address=185.167.204.206:4063 , piece_id=4RZJT7OCHNQOLKBC4RMK6KA5JFRAACMZZZFQLKJJWQOOPPXZ4TZA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: read tcp 188.166.225.170:47238->185.167.204.206:4063: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:28.763442570 (187h38m25.44363814s) [noise=true , address=185.167.204.206:4066 , piece_id=H5ZKHHR4H7EPVCDXLTMEQTELZTXUMZ63ARSJKLDJILD6J7PVLM2Q, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 188.166.225.170:35002->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:28.763457028 (187h38m25.443652597s) [noise=true , address=185.167.204.206:4061 , piece_id=AHPXK7MPM2QSV62WJO3CIDPZ3GAXEEFME6SUQN6J4EKNRTFJNAEA, seg_pos={0 0}, upload=165092]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 188.166.225.170:51496->185.167.204.206:4061: use of closed network connection; write tcp 188.166.225.170:51496->185.167.204.206:4061: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51496->185.167.204.206:4061: use of closed network connection Sep 6 09:46:28.763472498 (187h38m25.443668067s) [seg_pos={0 0}, upload=165092]: Done waiting for segment. successful: 5 optimal: 26 errs: <nil> Sep 6 09:46:28.938432761 (187h38m25.61862834s) [upload=165092]: Done uploading segments... Sep 6 09:46:28.938464492 (187h38m25.618660091s) [upload=165092]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 5) Duration: 1m0.177160262s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.........................X..] duration: 9.997052099s FAIL (2025-09-06 09:46:27 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 9.997078381s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration: 1m25.740147633s FAIL (2025-09-06 09:46:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1m25.740163473s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX] duration: 1m4.271585482s FAIL (2025-09-06 09:46:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== col: write tcp 188.166.225.170:51034->145.79.227.14:4852: use of closed network connection; write tcp 188.166.225.170:51034->145.79.227.14:4852: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51034->145.79.227.14:4852: use of closed network connection Sep 6 09:46:16.255511925 (187h38m12.935707494s) [noise=true , address=145.79.227.45:4235 , piece_id=2SIQ7GB6ZWNDHQ2JNMNLLAYDTAYGSZPCRN7STYDMJLAIBCVOGFTA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:1a1sW1G1WPL5WQ2XxprWKQMsJkcb5ETSkk3ULp1TjRaZWptaT, address:145.79.227.45:4235): protocol: write tcp 188.166.225.170:59278->145.79.227.45:4235: use of closed network connection; write tcp 188.166.225.170:59278->145.79.227.45:4235: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59278->145.79.227.45:4235: use of closed network connection Sep 6 09:46:16.255594904 (187h38m12.935790473s) [noise=true , address=145.79.227.33:4903 , piece_id=ETJ2NUMWBXZL4XN777FYM4XICEF46SLAEJ63RNYKFBGLYI5HHG5Q, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq, address:145.79.227.33:4903): protocol: write tcp 188.166.225.170:58470->145.79.227.33:4903: use of closed network connection; write tcp 188.166.225.170:58470->145.79.227.33:4903: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58470->145.79.227.33:4903: use of closed network connection Sep 6 09:46:16.255681701 (187h38m12.93587735s) [noise=true , address=77.90.31.17:4804 , piece_id=ZQ7VCUT2OJMLTLXVKKG3YNS52A7HLOXYJPYG2TN2RZOPGYAT2OPQ, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: write tcp 188.166.225.170:50800->77.90.31.17:4804: use of closed network connection; write tcp 188.166.225.170:50800->77.90.31.17:4804: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50800->77.90.31.17:4804: use of closed network connection Sep 6 09:46:16.255764529 (187h38m12.935960129s) [noise=true , address=77.90.31.12:4611 , piece_id=2DPAT7XLDC3CPC6WLA3NM2L5Q5R74RGL2QQGQHPAP62C3FKNBYBA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:1r7qdqiUuUqsKnTXdC3S1Ek84rsCPtjPoXbPugVHWBzJezv4W2, address:77.90.31.12:4611): protocol: write tcp 188.166.225.170:35364->77.90.31.12:4611: use of closed network connection; write tcp 188.166.225.170:35364->77.90.31.12:4611: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35364->77.90.31.12:4611: use of closed network connection Sep 6 09:46:16.255778576 (187h38m12.935974145s) [noise=true , address=45.91.116.10:4105 , piece_id=S4ERV3BVODP7TBJQGLYAE2LIKTFT6NIWQP4XDIHQPX76S2WTV2HQ, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:12D2biCCeFVigmPrTL1DchNPy9gtJZbaZLowMVajZrcTaizvPXV, address:45.91.116.10:4105): protocol: write tcp 188.166.225.170:59794->45.91.116.10:4105: use of closed network connection; write tcp 188.166.225.170:59794->45.91.116.10:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59794->45.91.116.10:4105: use of closed network connection Sep 6 09:46:16.255822300 (187h38m12.936017869s) [noise=true , address=77.90.31.13:4653 , piece_id=AAI46CDSINE5VPIPUDL5X4T773RNJPMKVD4NJBFFNQBE23OP7SCA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:12eaTnUhynF1XeuvMr68SjMyYKM9rLj5tShzpViHcMSjvMs9EBF, address:77.90.31.13:4653): protocol: write tcp 188.166.225.170:40884->77.90.31.13:4653: use of closed network connection; write tcp 188.166.225.170:40884->77.90.31.13:4653: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40884->77.90.31.13:4653: use of closed network connection Sep 6 09:46:16.255837989 (187h38m12.936033558s) [noise=true , address=77.90.31.12:4596 , piece_id=J4ETI466QFIMF3WT7IQY6XBIWOPYPVD7JG2Q5MBMORWZ4R3PTZTQ, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: write tcp 188.166.225.170:42638->77.90.31.12:4596: use of closed network connection; write tcp 188.166.225.170:42638->77.90.31.12:4596: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42638->77.90.31.12:4596: use of closed network connection Sep 6 09:46:16.255879730 (187h38m12.936075299s) [noise=true , address=145.79.227.31:4808 , piece_id=UJH3QUL7QURYVNF6433J3GLTA6VOK7MH5M56KNC3VMRO24C3J4QA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:1dBGnojgbYNwFfATQTahFBnkvZCGyZLiwRBa3AYv4iVY4U3yE2, address:145.79.227.31:4808): protocol: write tcp 188.166.225.170:50214->145.79.227.31:4808: use of closed network connection; write tcp 188.166.225.170:50214->145.79.227.31:4808: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50214->145.79.227.31:4808: use of closed network connection Sep 6 09:46:16.255906070 (187h38m12.936101639s) [noise=true , address=145.79.227.18:4016 , piece_id=UBVSE7O67MT5C22IVIPWD3ETC77UAZGT4SUHIWBFYRMF3A3DOKXA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:12vV7puUjzyuxvoUYvc8dASE6bQwPTFeZSW4ZakTbBYWDfGtQoV, address:145.79.227.18:4016): protocol: write tcp 188.166.225.170:42640->145.79.227.18:4016: use of closed network connection; write tcp 188.166.225.170:42640->145.79.227.18:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42640->145.79.227.18:4016: use of closed network connection Sep 6 09:46:16.255936188 (187h38m12.936131757s) [noise=true , address=145.79.227.11:4735 , piece_id=W3DF3YUCJVAAL7RABC3DKH2Q6LC2VBN3GJXLX4GRP2BR6UK4B7QQ, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:125ShGXckiJ3N5UWVmsMdhj98oFaRN7sg1KRucyUzqENW4Jp4kS, address:145.79.227.11:4735): protocol: write tcp 188.166.225.170:48170->145.79.227.11:4735: use of closed network connection; write tcp 188.166.225.170:48170->145.79.227.11:4735: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48170->145.79.227.11:4735: use of closed network connection Sep 6 09:46:16.255955986 (187h38m12.936151555s) [noise=true , address=145.79.227.43:4176 , piece_id=5H2NFOYFBQD53CHZBE4YZ2SOJ7OIK442A4OWJ7VXNNYX23USTBCA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD, address:145.79.227.43:4176): protocol: write tcp 188.166.225.170:36342->145.79.227.43:4176: use of closed network connection; write tcp 188.166.225.170:36342->145.79.227.43:4176: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36342->145.79.227.43:4176: use of closed network connection Sep 6 09:46:16.255976725 (187h38m12.936172284s) [noise=true , address=145.79.227.30:4768 , piece_id=CRBL2QXQE75J74Z7WVS4PQXOTOM3ECCADBQOLZNCRZE47PJLTI2Q, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:1g7r2boMdct1YvKxHZ5U3RM923N4UDfGNKGtYyAm6VKwfKAJn4, address:145.79.227.30:4768): protocol: write tcp 188.166.225.170:54636->145.79.227.30:4768: use of closed network connection; write tcp 188.166.225.170:54636->145.79.227.30:4768: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54636->145.79.227.30:4768: use of closed network connection Sep 6 09:46:16.256085072 (187h38m12.936280641s) [noise=true , address=145.79.227.37:4584 , piece_id=272NFUPZLKLLD5ZE3YVL5KK7XVCQT5R4EJYEF5WF2MUN5OQ2RLEQ, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:12uS1kJzcCiNR4GwBxZqkGoSoGYJCDnwUPMpJLn6KrPE59Hq2S, address:145.79.227.37:4584): protocol: read tcp 188.166.225.170:51462->145.79.227.37:4584: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:16.256114659 (187h38m12.936310228s) [noise=true , address=45.91.116.12:4237 , piece_id=CRYXKYB2PD5Z65XKW7MO5UFYCDE6AKO66GINUAMANRHFW2AO5MLA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:1FMjHdNGV42a9QZyMmSPTJWQrA8CdSRvXqrimnt6UGVreCzmgF, address:45.91.116.12:4237): protocol: read tcp 188.166.225.170:36064->45.91.116.12:4237: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:16.256143835 (187h38m12.936339404s) [noise=true , address=145.79.227.32:4842 , piece_id=HJBF4YUIV2OS2HDO5XSYO6WA3RUW374BOHVLTHP7AV3UNWSWNUJA, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:125yXSpQg4vxVMtduWXbAUqsLRvQ2b2cDBgHi7Z23dz4fvo5Det, address:145.79.227.32:4842): protocol: write tcp 188.166.225.170:59518->145.79.227.32:4842: use of closed network connection; write tcp 188.166.225.170:59518->145.79.227.32:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59518->145.79.227.32:4842: use of closed network connection Sep 6 09:46:16.256171899 (187h38m12.936367468s) [noise=true , address=145.79.227.17:4998 , piece_id=VLYMREBCLIHRCHDUK233YHW7SDVZV4QX3HUFUI2QOM43YO4DYDYQ, seg_pos={0 0}, upload=165090]: Done uploading piece. err: ecclient: upload failed (node:12m8BAEezShMZxBdiwdLhUD6FVbQfDdaFmNDkdM1mKC4WYsidMR, address:145.79.227.17:4998): protocol: read tcp 188.166.225.170:58266->145.79.227.17:4998: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:46:16.256197718 (187h38m12.936393287s) [seg_pos={0 0}, upload=165090]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m4.271610769s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [.................................XXX....X.XX..X.............] duration: 20.999138119s target: https://us1.storj.io/login FAIL (2025-09-06 09:46:17 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 20.999161033s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 15 out of 60 is failed (threshold=3) [..............................XXXXXX.....XXX.X.X.XXXX.......] duration: 21.863922379s FAIL (2025-09-06 09:46:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:40:55.687477176 (187h32m52.367672745s) [upload=165027]: Starting upload Sep 6 09:40:55.687529276 (187h32m52.367724835s) [upload=165027]: Done starting upload Sep 6 09:40:55.687623947 (187h32m52.367819516s) [upload=165027]: Uploading segments... Sep 6 09:40:55.687661369 (187h32m52.367856938s) [upload=165027]: Got next segment. Inline: true Sep 6 09:40:55.687665246 (187h32m52.367860815s) [upload=165027]: Waiting for error group managing segments... Sep 6 09:40:55.687720752 (187h32m52.367916321s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:40:55.687725201 (187h32m52.36792077s) [upload=165027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:40:55.687728007 (187h32m52.367923576s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:41:17.325212667 (187h33m14.005408236s) [upload=165027]: Done uploading segments... Sep 6 09:41:17.325231412 (187h33m14.005426981s) [upload=165027]: Upload finished. err: <nil> Duration:* 21.863951235s core uplink us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.822124916s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:46:13 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 5.822152778s edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.000888951s FAIL (2025-09-06 09:46:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 30.000917996s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [..............................X.X.X.X.XX.XXX.X..X...X..X....] duration: 15.75978991s FAIL (2025-09-06 09:46:10 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 15.759817432s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration: 1m0.001143693s FAIL (2025-09-06 09:46:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001155095s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [...........................................X.X..X.XX........] duration: 13.6454792s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:45:57 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 13.645500923s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 20 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXX...XXXXXX...X.X..] duration: 21.165697674s FAIL (2025-09-06 09:45:57 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.165723784s edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X.........................X.] duration: 3.567519438s FAIL (2025-09-06 09:45:45 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 3.567546011s core uplink ap1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [..................................XXX....X.XX..X............] duration: 9.228217918s target: https://us1.storj.io/login FAIL (2025-09-06 09:45:38 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 9.22824966s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [...............................X.X.X.X.XX.XXX.X..X...X..X...] duration: 27.1581855s FAIL (2025-09-06 09:45:37 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 27.15820106s core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.........................X] duration: 30.026320319s FAIL (2025-09-06 09:45:36 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 30.026363441s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 15 out of 60 is failed (threshold=3) [...............................XXXXXX.....XXX.X.X.XXXX......] duration: 30.001254665s FAIL (2025-09-06 09:45:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:40:55.687477176 (187h32m52.367672745s) [upload=165027]: Starting upload Sep 6 09:40:55.687529276 (187h32m52.367724835s) [upload=165027]: Done starting upload Sep 6 09:40:55.687623947 (187h32m52.367819516s) [upload=165027]: Uploading segments... Sep 6 09:40:55.687661369 (187h32m52.367856938s) [upload=165027]: Got next segment. Inline: true Sep 6 09:40:55.687665246 (187h32m52.367860815s) [upload=165027]: Waiting for error group managing segments... Sep 6 09:40:55.687720752 (187h32m52.367916321s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:40:55.687725201 (187h32m52.36792077s) [upload=165027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:40:55.687728007 (187h32m52.367923576s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:41:17.325212667 (187h33m14.005408236s) [upload=165027]: Done uploading segments... Sep 6 09:41:17.325231412 (187h33m14.005426981s) [upload=165027]: Upload finished. err: <nil> Duration:* 30.001276266s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [............................................X.X..X.XX.......] duration: 22.603961181s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:45:34 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 22.603978034s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 10 out of 60 is failed (threshold=3) [.......................................XX...XX....XXXX..XX..] duration: 41.707281219s FAIL (2025-09-06 09:45:32 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:43:28.794898373 (187h35m25.475093942s) [upload=165065]: Starting upload Sep 6 09:43:28.794972525 (187h35m25.475168094s) [upload=165065]: Done starting upload Sep 6 09:43:28.795036117 (187h35m25.475231686s) [upload=165065]: Uploading segments... Sep 6 09:43:28.795083598 (187h35m25.475279167s) [upload=165065]: Got next segment. Inline: true Sep 6 09:43:28.795089008 (187h35m25.475284587s) [upload=165065]: Waiting for error group managing segments... Sep 6 09:43:28.795129776 (187h35m25.475325345s) [upload=165065]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:43:28.795134866 (187h35m25.475330435s) [upload=165065]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:43:28.795138643 (187h35m25.475334212s) [upload=165065]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:43:29.886570850 (187h35m26.566766499s) [upload=165065]: Done uploading segments... Sep 6 09:43:29.886590328 (187h35m26.566785897s) [upload=165065]: Upload finished. err: <nil> Duration:* 41.707296729s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.875714243s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:45:29 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 1.875742568s edge linksharing us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX] duration: 1m0.172386495s FAIL (2025-09-06 09:45:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 7) ======LOGS====== 2LPXEMN35JUQA, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:36184->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:36184->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36184->81.171.14.70:4032: use of closed network connection Sep 6 09:45:28.328852446 (187h37m25.009048015s) [noise=true , address=185.167.204.205:4020 , piece_id=V435BRBEMTXRZWBAPVQ2J476FFHUVQWHYESFY6TXGCWNFZFQIMQQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:45:28.328867764 (187h37m25.009063333s) [noise=true , address=185.167.204.206:4057 , piece_id=Y4LRT5UAIC5TNB3YLNAAF5AX34S4SUVIAKXYURZD72CUHWWDEAXQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: write tcp 188.166.225.170:50358->185.167.204.206:4057: use of closed network connection; write tcp 188.166.225.170:50358->185.167.204.206:4057: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50358->185.167.204.206:4057: use of closed network connection Sep 6 09:45:28.329096102 (187h37m25.009291671s) [noise=true , address=185.167.204.206:4070 , piece_id=GKZHR632YXB5V622M2IYEFVBNQKFVBZI4A5OGULYBFJFZ4NGRPDA, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: write tcp 188.166.225.170:35248->185.167.204.206:4070: use of closed network connection; write tcp 188.166.225.170:35248->185.167.204.206:4070: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35248->185.167.204.206:4070: use of closed network connection Sep 6 09:45:28.329134665 (187h37m25.009330234s) [noise=true , address=185.167.204.206:4044 , piece_id=DTB5PQ4TQ3OWQ2ZDYU67PO6G4ZF7463MKPDE6G54FQUHHWW52D2Q, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: read tcp 188.166.225.170:51918->185.167.204.206:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:28.329159974 (187h37m25.009355543s) [noise=true , address=185.167.204.206:4071 , piece_id=U4ZGPJYNHBDF3QUVCSXXJ2EC3ZKFKULZOF3SNG2QORNWSTFLWOGQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:39714->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:39714->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39714->185.167.204.206:4071: use of closed network connection Sep 6 09:45:28.329172517 (187h37m25.009368086s) [noise=true , address=185.167.204.206:4062 , piece_id=5FLDFCCCH6HCPKXP4LQGL2CFSUH7PIUR76TKFWYG3CX2ILLHVX2A, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: read tcp 188.166.225.170:39738->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:28.329211302 (187h37m25.009406871s) [noise=true , address=185.167.204.206:4065 , piece_id=PYTSEDC26HKL5ABTB57QL5VUNNOLQBPPEKCPTKXIHB4HQZXH75KA, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: read tcp 188.166.225.170:46504->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:28.329231381 (187h37m25.00942696s) [noise=true , address=185.167.204.205:4012 , piece_id=NZYPS7WRMHVQFSKBLNCPSAJ7HVJFZUUCLRV3GMEO34XABE66CZVA, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:35742->185.167.204.205:4012: use of closed network connection; write tcp 188.166.225.170:35742->185.167.204.205:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35742->185.167.204.205:4012: use of closed network connection Sep 6 09:45:28.329294311 (187h37m25.00948989s) [noise=true , address=185.167.204.205:4019 , piece_id=UICMH62EMNUZQ62YSJQVNKAXLMHL6WGTGXCWNEJNWN4J3UKUNOSQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12CwWyCCjbNNuuSxpk9PhiWxG2yvuT19gDyJhezMfUEez6LrpDj, address:185.167.204.205:4019): protocol: write tcp 188.166.225.170:46412->185.167.204.205:4019: use of closed network connection; write tcp 188.166.225.170:46412->185.167.204.205:4019: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46412->185.167.204.205:4019: use of closed network connection Sep 6 09:45:28.329305923 (187h37m25.009501522s) [noise=true , address=185.167.204.205:4017 , piece_id=KPZTA3WZ6A5QPHZOL64UT75TYUGVIJDD3G3HMPUP2OJOA7JAPGYQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: write tcp 188.166.225.170:45624->185.167.204.205:4017: use of closed network connection; write tcp 188.166.225.170:45624->185.167.204.205:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45624->185.167.204.205:4017: use of closed network connection Sep 6 09:45:28.329343195 (187h37m25.009538764s) [noise=true , address=81.171.14.70:4047 , piece_id=4Q6367NLBUEUWAY2Z4CYYONZWAK4MDKQE5BODRUXFTG52Q2XRLDA, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:46362->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:46362->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46362->81.171.14.70:4047: use of closed network connection Sep 6 09:45:28.329381167 (187h37m25.009576736s) [noise=true , address=81.171.14.70:4035 , piece_id=I3LCLOLBA3DNW36TSMTOWNZZKDM7KLT7W4L5JGPMKZVTUVUS4GNQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:59372->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:59372->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59372->81.171.14.70:4035: use of closed network connection Sep 6 09:45:28.329426434 (187h37m25.009622053s) [noise=true , address=81.171.14.70:4046 , piece_id=E3WTMVGKGIIL4ERKNA2VRVGN7NCLE2PILNORDL6VVX7AX5QXI6WQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:38166->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:38166->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38166->81.171.14.70:4046: use of closed network connection Sep 6 09:45:28.329464286 (187h37m25.009659855s) [noise=true , address=185.167.204.206:4058 , piece_id=DBB72AJBQC42MAZ6WUX34PO2XF5CVJAMT5E453KTTMGLYPH73UYQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: read tcp 188.166.225.170:34532->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:28.329481289 (187h37m25.009676858s) [noise=true , address=185.167.204.205:4021 , piece_id=ICU4GOAR3AL7UFUH6GCHOQP7FYZ3HITLIHRWYTWYVDQ2365SDVEA, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: read tcp 188.166.225.170:52768->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:28.329501367 (187h37m25.009696936s) [noise=true , address=81.171.14.70:4033 , piece_id=D3ZK4PRZSN4HN6SMR3IAK2TXYJOWLPKHAYV5L3ZBEJWPJKFHBCUQ, seg_pos={0 0}, upload=165079]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:56958->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:56958->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56958->81.171.14.70:4033: use of closed network connection Sep 6 09:45:28.329529831 (187h37m25.0097254s) [seg_pos={0 0}, upload=165079]: Done waiting for segment. successful: 7 optimal: 26 errs: <nil> Sep 6 09:45:28.498941127 (187h37m25.179136696s) [upload=165079]: Done uploading segments... Sep 6 09:45:28.498967438 (187h37m25.179163007s) [upload=165079]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 7) Duration: 1m0.172398608s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 20 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXX...XXXXXX...X.X.] duration: 22.068507591s FAIL (2025-09-06 09:45:24 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.068539322s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.469011882s FAIL (2025-09-06 09:45:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== upload=165081]: Uploading piece... Sep 6 09:44:51.979577203 (187h36m48.659772772s) [noise=true , address=77.90.31.15:4699 , piece_id=B3EKDH4U4G2VEQKMBCLP5SEUKWZXDYGZCOK3YXSVDTTFCAFJGA4Q, seg_pos={0 0}, upload=165081]: Uploading piece... Sep 6 09:44:51.979888598 (187h36m48.660084167s) [noise=true , address=45.91.116.11:4119 , piece_id=CJB2N46YWC45Q6FJ5524ADEG5HHOYJKDI7DRWDPBBZFN3H4DEDDQ, seg_pos={0 0}, upload=165081]: Uploading piece... Sep 6 09:44:51.980132856 (187h36m48.660328425s) [noise=true , address=77.90.31.15:4697 , piece_id=N24CSFWHOSHJORFB4FNQHC5BH3TW37BWFQWSOKMJ62JEI54PFE3A, seg_pos={0 0}, upload=165081]: Uploading piece... Sep 6 09:45:15.158594556 (187h37m11.838790125s) [upload=165081]: Next segment err: context deadline exceeded Sep 6 09:45:15.159232937 (187h37m11.839428506s) [noise=true , address=45.91.116.14:4191 , piece_id=V56CSHQCGIEXDV5FX2VJTYHX4NPB7HQVP454TBW22TAZ23YQL3GQ, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: write tcp 188.166.225.170:48752->45.91.116.14:4191: use of closed network connection; write tcp 188.166.225.170:48752->45.91.116.14:4191: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48752->45.91.116.14:4191: use of closed network connection Sep 6 09:45:15.159305116 (187h37m11.839500715s) [noise=true , address=77.90.31.15:4699 , piece_id=B3EKDH4U4G2VEQKMBCLP5SEUKWZXDYGZCOK3YXSVDTTFCAFJGA4Q, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:60612->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:60612->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60612->77.90.31.15:4699: use of closed network connection Sep 6 09:45:15.159353609 (187h37m11.839549178s) [noise=true , address=77.90.31.19:4842 , piece_id=Y54QY7JBRMUMST7BDUTBMMBO7XRGWCJ2LEDCNKHBUIP2ZABAVX7Q, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 188.166.225.170:52336->77.90.31.19:4842: use of closed network connection; write tcp 188.166.225.170:52336->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52336->77.90.31.19:4842: use of closed network connection Sep 6 09:45:15.159456816 (187h37m11.839652385s) [noise=true , address=45.91.116.13:4154 , piece_id=WRLTXKFPFYCHKHYKXJDJJVTHSNUWL33ZPEPMBTQU2IWMLGYV67VA, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 188.166.225.170:41780->45.91.116.13:4154: use of closed network connection; write tcp 188.166.225.170:41780->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41780->45.91.116.13:4154: use of closed network connection Sep 6 09:45:15.159494057 (187h37m11.839689626s) [noise=true , address=77.90.31.16:4734 , piece_id=DBDGUNFRA2BWSW22OG7X3VSAIRYZLRL2Z4V7ZFZJECPSQJUK2KUQ, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:33986->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:33986->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33986->77.90.31.16:4734: use of closed network connection Sep 6 09:45:15.159527972 (187h37m11.839723541s) [noise=true , address=45.91.116.11:4119 , piece_id=CJB2N46YWC45Q6FJ5524ADEG5HHOYJKDI7DRWDPBBZFN3H4DEDDQ, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 188.166.225.170:59824->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:59824->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59824->45.91.116.11:4119: use of closed network connection Sep 6 09:45:15.159572297 (187h37m11.839767876s) [noise=true , address=77.90.31.15:4697 , piece_id=N24CSFWHOSHJORFB4FNQHC5BH3TW37BWFQWSOKMJ62JEI54PFE3A, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:53596->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:53596->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53596->77.90.31.15:4697: use of closed network connection Sep 6 09:45:15.159631450 (187h37m11.839827019s) [noise=true , address=45.91.116.12:4226 , piece_id=CASJIR72R6O4IVRG3CESFVNKOCYD7Y6YQLC4R3SPNQQMRSZHH5KA, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:59226->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:59226->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59226->45.91.116.12:4226: use of closed network connection Sep 6 09:45:15.159862672 (187h37m11.840058241s) [noise=true , address=77.90.31.14:4663 , piece_id=SOMGAPMFBAVBTEYC6QPCOBOHRJCZ2ELALBJOGPHY52CQRDRLIN3A, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:59414->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:59414->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59414->77.90.31.14:4663: use of closed network connection Sep 6 09:45:15.160061083 (187h37m11.840256652s) [noise=true , address=45.91.116.9:4263 , piece_id=BF4FSY2X3DSL3GDP3BBUL3CUZBWU54TM2P3QP3XYEWULFPEWRJSQ, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:47942->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:47942->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47942->45.91.116.9:4263: use of closed network connection Sep 6 09:45:15.160187213 (187h37m11.840382792s) [noise=true , address=45.91.116.7:4011 , piece_id=36ZEEIGLASJH3OWN26L5SQYGLKGYPUXZZSNPODVLW77I23ROX35Q, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:40554->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:15.160224706 (187h37m11.840420275s) [noise=true , address=77.90.31.19:4841 , piece_id=W47FGJXUQ757UODAIOUFSPFRKF74REI6FELWM7DO7BMC32XF242Q, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:42948->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:15.160253521 (187h37m11.84044908s) [noise=true , address=45.91.116.6:4974 , piece_id=POCH4Z632WHBYQLMIS3YWBNY4VLIC6OPTNGBS3NIZLCXCKFSA6UA, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: read tcp 188.166.225.170:51076->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:15.160285271 (187h37m11.840480841s) [noise=true , address=77.90.31.19:4843 , piece_id=CIWAFUE34VTMKEHVF6SK4PEBCBSNZDAA6EDA4VZQ4NXTFG76MQNQ, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: read tcp 188.166.225.170:48666->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:15.160315860 (187h37m11.840511429s) [noise=true , address=77.90.31.10:4517 , piece_id=EWQUJNMKTEPHBICZP2GXKXDMBBJSBJRHMAIT3YSLISKMYY7DRBVA, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 188.166.225.170:55034->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:15.160342471 (187h37m11.84053804s) [noise=true , address=77.90.31.12:4592 , piece_id=67A5KIMHBIRC5FGAZUIT5RBJXWX6O5ERSIUUUSX6EI4JZEHYQH6Q, seg_pos={0 0}, upload=165081]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: read tcp 188.166.225.170:48540->77.90.31.12:4592: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:45:15.160353992 (187h37m11.840549561s) [seg_pos={0 0}, upload=165081]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.46904691s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 7 out of 60 is failed (threshold=3) [...............................X..X....X.X........X.X....X..] duration: 6.267994966s FAIL (2025-09-06 09:45:10 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 48) Duration: 6.2680223s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [................................X.X.X.X.XX.XXX.X..X...X..X..] duration: 20.957306232s FAIL (2025-09-06 09:45:09 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 20.95733057s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [...................................XXX....X.XX..X...........] duration: 7.294720618s target: https://us1.storj.io/login FAIL (2025-09-06 09:45:08 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 7.2947436s core satellite us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX] duration: 1m0.000657968s FAIL (2025-09-06 09:45:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000670111s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration: 1m0.0007645s FAIL (2025-09-06 09:45:05 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1m0.000781112s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 6 out of 60 is failed (threshold=3) [.........................................X..X..X..X.X.....X.] duration: 10.65277595s FAIL (2025-09-06 09:45:05 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 10.65279219s edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 6 out of 60 is failed (threshold=3) [..........................................X..X..X..X.X.....X] duration: 2m0.000195267s FAIL (2025-09-06 09:44:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2m0.000227009s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration: 35.889187234s FAIL (2025-09-06 09:44:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 35.889210639s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 10 out of 60 is failed (threshold=3) [........................................XX...XX....XXXX..XX.] duration: 26.639082189s FAIL (2025-09-06 09:44:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:43:28.794898373 (187h35m25.475093942s) [upload=165065]: Starting upload Sep 6 09:43:28.794972525 (187h35m25.475168094s) [upload=165065]: Done starting upload Sep 6 09:43:28.795036117 (187h35m25.475231686s) [upload=165065]: Uploading segments... Sep 6 09:43:28.795083598 (187h35m25.475279167s) [upload=165065]: Got next segment. Inline: true Sep 6 09:43:28.795089008 (187h35m25.475284587s) [upload=165065]: Waiting for error group managing segments... Sep 6 09:43:28.795129776 (187h35m25.475325345s) [upload=165065]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:43:28.795134866 (187h35m25.475330435s) [upload=165065]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:43:28.795138643 (187h35m25.475334212s) [upload=165065]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:43:29.886570850 (187h35m26.566766499s) [upload=165065]: Done uploading segments... Sep 6 09:43:29.886590328 (187h35m26.566785897s) [upload=165065]: Upload finished. err: <nil> Duration:* 26.639137796s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 20 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXX...XXXXXX...X.X] duration: 30.00200426s FAIL (2025-09-06 09:44:44 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00202446s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 863.630811ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:44:42 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 863.654276ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 11.42544348s FAIL (2025-09-06 09:44:39 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 11.425460474s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 15 out of 60 is failed (threshold=3) [................................XXXXXX.....XXX.X.X.XXXX.....] duration: 20.261989151s FAIL (2025-09-06 09:44:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:40:55.687477176 (187h32m52.367672745s) [upload=165027]: Starting upload Sep 6 09:40:55.687529276 (187h32m52.367724835s) [upload=165027]: Done starting upload Sep 6 09:40:55.687623947 (187h32m52.367819516s) [upload=165027]: Uploading segments... Sep 6 09:40:55.687661369 (187h32m52.367856938s) [upload=165027]: Got next segment. Inline: true Sep 6 09:40:55.687665246 (187h32m52.367860815s) [upload=165027]: Waiting for error group managing segments... Sep 6 09:40:55.687720752 (187h32m52.367916321s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:40:55.687725201 (187h32m52.36792077s) [upload=165027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:40:55.687728007 (187h32m52.367923576s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:41:17.325212667 (187h33m14.005408236s) [upload=165027]: Done uploading segments... Sep 6 09:41:17.325231412 (187h33m14.005426981s) [upload=165027]: Upload finished. err: <nil> Duration:* 20.262006804s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [....................................XXX....X.XX..X..........] duration: 39.054703741s target: https://us1.storj.io/login FAIL (2025-09-06 09:44:29 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 39.05472945s core satellite us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX] duration: 1m0.171356501s FAIL (2025-09-06 09:44:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 8) ======LOGS====== 5.170:50114->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50114->81.171.14.70:4035: use of closed network connection Sep 6 09:44:27.926557423 (187h36m24.606752992s) [noise=true , address=81.171.14.70:4046 , piece_id=DMRFVZQ3OO2FCJGBMYQVZ2J4VDQI2L4GD3RW7HHXBP34QQJDPNYQ, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:39052->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:39052->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39052->81.171.14.70:4046: use of closed network connection Sep 6 09:44:27.926595726 (187h36m24.606791295s) [noise=true , address=185.167.204.206:4037 , piece_id=NM2LPHBXSNCXQTNUSX6SXHLSNXIIHP5U5GWGPRGOUDASGKBC5HBQ, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: rpc: dial tcp 185.167.204.206:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:44:27.926630282 (187h36m24.606825851s) [noise=true , address=185.167.204.206:4054 , piece_id=2Z7FRHRJVNE4I6HXDMKOHV7TEWAXNCLOTDIADRFP7JUNUJNKHAVQ, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: write tcp 188.166.225.170:42890->185.167.204.206:4054: use of closed network connection; write tcp 188.166.225.170:42890->185.167.204.206:4054: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42890->185.167.204.206:4054: use of closed network connection Sep 6 09:44:27.926663946 (187h36m24.606859516s) [noise=true , address=185.167.204.206:4060 , piece_id=ZB65A5ECREL6NCYOIEZRHDCEKTQRYY5LNGSIYN55VXVWHUBBVVJQ, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:45588->185.167.204.206:4060: use of closed network connection; write tcp 188.166.225.170:45588->185.167.204.206:4060: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45588->185.167.204.206:4060: use of closed network connection Sep 6 09:44:27.926683174 (187h36m24.606878733s) [noise=true , address=185.167.204.206:4068 , piece_id=LQ4B2HM7UXWV6ORIZSSQ63VWID6UDE5XNZMCUTLIGMUDH366A3ZQ, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 188.166.225.170:58576->185.167.204.206:4068: use of closed network connection; write tcp 188.166.225.170:58576->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58576->185.167.204.206:4068: use of closed network connection Sep 6 09:44:27.926698183 (187h36m24.606893752s) [noise=true , address=185.167.204.205:4015 , piece_id=JPNHYG2BOUWUDYNEMQYCMMYEQNHSBWTGQC7NF2P663A3FP7AUJFA, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: write tcp 188.166.225.170:57012->185.167.204.205:4015: use of closed network connection; write tcp 188.166.225.170:57012->185.167.204.205:4015: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57012->185.167.204.205:4015: use of closed network connection Sep 6 09:44:27.926732168 (187h36m24.606927737s) [noise=true , address=185.167.204.206:4058 , piece_id=MPUXMEE3JFO2RBKNMSL4FBWJAZXX76YO4KS7MRE6AD4HVSZ5F3MQ, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:41176->185.167.204.206:4058: use of closed network connection; write tcp 188.166.225.170:41176->185.167.204.206:4058: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->185.167.204.206:4058: use of closed network connection Sep 6 09:44:27.926746665 (187h36m24.606942224s) [noise=true , address=81.171.14.70:4030 , piece_id=Q25EJS5M65MRPSK7DJBVNVFL2JY6SHGAJUVQQMCFW6Q7KMOKZHHA, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:56920->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:56920->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56920->81.171.14.70:4030: use of closed network connection Sep 6 09:44:27.926765661 (187h36m24.60696122s) [noise=true , address=185.167.204.205:4025 , piece_id=ECBOW34JTR6Z2VYRI6NUWBZOFI7RKSTEWKXXNEFATYNIFE7NO52Q, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: read tcp 188.166.225.170:55774->185.167.204.205:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:44:27.926789577 (187h36m24.606985136s) [noise=true , address=81.171.14.70:4047 , piece_id=YS5DTQVWMTM5SKSU6SNZHR344WC2ILYTBKPFGVAUU7X7VCWYONPQ, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:50358->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:50358->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50358->81.171.14.70:4047: use of closed network connection Sep 6 09:44:27.926824494 (187h36m24.607020053s) [noise=true , address=185.167.204.206:4051 , piece_id=FN4TK4IOFHR7SHDBFNO46FK5TP2B62VTIZ6YCNP5ZTUFH5B2HXZA, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:59690->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:59690->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59690->185.167.204.206:4051: use of closed network connection Sep 6 09:44:27.926855764 (187h36m24.607051333s) [noise=true , address=81.171.14.70:4029 , piece_id=MUG2YOU7VMDFYV55XOP6V2O6SPACJ6LN4CQUIXI6FJJUL7PFPISA, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:41130->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:41130->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41130->81.171.14.70:4029: use of closed network connection Sep 6 09:44:27.926892134 (187h36m24.607087703s) [noise=true , address=185.167.204.205:4007 , piece_id=6HL6QMPXWVMKIUOL3ZFV6PDMJZ7YXZFHLXJSFEFJGZTWYCZY76IA, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12m7e6EGQBC1wvbRQ5uwG8wuHbgZeyXPdj5XDMi1kgo5woPgXR, address:185.167.204.205:4007): protocol: write tcp 188.166.225.170:36374->185.167.204.205:4007: use of closed network connection; write tcp 188.166.225.170:36374->185.167.204.205:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36374->185.167.204.205:4007: use of closed network connection Sep 6 09:44:27.926917142 (187h36m24.607112711s) [noise=true , address=185.167.204.206:4052 , piece_id=EDTII5ET2BHUTJ4YREQ3ONPKIFRPF7ONUAEZY5NP4H62OMTXPLBA, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: write tcp 188.166.225.170:37420->185.167.204.206:4052: use of closed network connection; write tcp 188.166.225.170:37420->185.167.204.206:4052: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37420->185.167.204.206:4052: use of closed network connection Sep 6 09:44:27.926948972 (187h36m24.607144531s) [noise=true , address=185.167.204.205:4010 , piece_id=V3TV6FFILIW7LPQXZ6QSBXLCPP2XTOMVVXR3ZTILT44R3RRXYT5A, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: read tcp 188.166.225.170:42198->185.167.204.205:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:44:27.927074462 (187h36m24.607270111s) [noise=true , address=81.171.14.70:4025 , piece_id=M44ABILYR6TX34ZX2GGLNAPBTZDCOXODTIQQNQP2XF6R3K275QFA, seg_pos={0 0}, upload=165064]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:49240->81.171.14.70:4025: use of closed network connection; conn closed: op Sep 6 09:44:27.927121132 (187h36m24.607316761s) [seg_pos={0 0}, upload=165064]: Done waiting for segment. successful: 8 optimal: 26 errs: <nil> Sep 6 09:44:28.095966774 (187h36m24.776162343s) [upload=165064]: Done uploading segments... Sep 6 09:44:28.095991482 (187h36m24.776187051s) [upload=165064]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 8) Duration: 1m0.171378232s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 4.210671284s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:44:28 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 4.210699968s edge linksharing us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [.............................................X.X..X.XX......] duration: 4.850498156s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:44:27 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 4.850513294s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.000471874s FAIL (2025-09-06 09:44:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000496661s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 10 out of 60 is failed (threshold=3) [.........................................XX...XX....XXXX..XX] duration: 1m0.001138513s FAIL (2025-09-06 09:44:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:43:28.794898373 (187h35m25.475093942s) [upload=165065]: Starting upload Sep 6 09:43:28.794972525 (187h35m25.475168094s) [upload=165065]: Done starting upload Sep 6 09:43:28.795036117 (187h35m25.475231686s) [upload=165065]: Uploading segments... Sep 6 09:43:28.795083598 (187h35m25.475279167s) [upload=165065]: Got next segment. Inline: true Sep 6 09:43:28.795089008 (187h35m25.475284587s) [upload=165065]: Waiting for error group managing segments... Sep 6 09:43:28.795129776 (187h35m25.475325345s) [upload=165065]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:43:28.795134866 (187h35m25.475330435s) [upload=165065]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:43:28.795138643 (187h35m25.475334212s) [upload=165065]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:43:29.886570850 (187h35m26.566766499s) [upload=165065]: Done uploading segments... Sep 6 09:43:29.886590328 (187h35m26.566785897s) [upload=165065]: Upload finished. err: <nil> Duration:* 1m0.001158551s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)