Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [............................................XX...XX....XXXX.] duration: 39.951689258s FAIL (2025-09-06 09:41:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:40:03.132906827 (187h31m59.813102396s) [upload=165017]: Starting upload Sep 6 09:40:03.132979777 (187h31m59.813175356s) [upload=165017]: Done starting upload Sep 6 09:40:03.133037107 (187h31m59.813232676s) [upload=165017]: Uploading segments... Sep 6 09:40:03.133078547 (187h31m59.813274126s) [upload=165017]: Got next segment. Inline: true Sep 6 09:40:03.133083235 (187h31m59.813278814s) [upload=165017]: Waiting for error group managing segments... Sep 6 09:40:03.133126047 (187h31m59.813321626s) [upload=165017]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:40:03.133131979 (187h31m59.813327558s) [upload=165017]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:40:03.133134964 (187h31m59.813330534s) [upload=165017]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:40:52.986772975 (187h32m49.666968544s) [upload=165017]: Done uploading segments... Sep 6 09:40:52.986797041 (187h32m49.66699261s) [upload=165017]: Upload finished. err: metaclient: context deadline exceeded Duration:* 39.951707061s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [.......................................XXX....X.XX..X.......] duration: 6.058799088s target: https://us1.storj.io/login FAIL (2025-09-06 09:41:31 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 6.058822372s core satellite us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.880588609s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:41:28 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 1.880612324s edge linksharing us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration: 1m0.174341677s FAIL (2025-09-06 09:41:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 7) ======LOGS====== PLQOBNNGEHKLYJDWYXKFMO4HNA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:41:26.044455904 (187h33m22.724651473s) [noise=true , address=185.167.204.205:4012 , piece_id=EE32UPP2BAVPFJY33RIVD22WKXQKXKQKQMWYA66F2LYFMULNGP2Q, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:56060->185.167.204.205:4012: use of closed network connection; write tcp 188.166.225.170:56060->185.167.204.205:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56060->185.167.204.205:4012: use of closed network connection Sep 6 09:41:26.044489900 (187h33m22.724685469s) [noise=true , address=81.171.14.70:4025 , piece_id=CPTISKRKDQMPT35RYDKXVNGBIZ6LJTJUPYWJYBGREGMA4AQ2HERA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:56642->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:56642->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56642->81.171.14.70:4025: use of closed network connection Sep 6 09:41:26.044529285 (187h33m22.724724854s) [noise=true , address=185.167.204.205:4014 , piece_id=33QTDR2XFV55MS3DWE5PW46RLWBTG4BQPPUBTEOI6HJZYBIFYV5A, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 188.166.225.170:35176->185.167.204.205:4014: use of closed network connection; write tcp 188.166.225.170:35176->185.167.204.205:4014: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35176->185.167.204.205:4014: use of closed network connection Sep 6 09:41:26.044673401 (187h33m22.72486897s) [noise=true , address=185.167.204.205:4025 , piece_id=VXR2H2YLC53LJ3E6OUQBCS53KX7UTJIJZWHWK3EBAL677OO2JKSQ, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: read tcp 188.166.225.170:35360->185.167.204.205:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:41:26.044706124 (187h33m22.724901683s) [noise=true , address=81.171.14.70:4026 , piece_id=FC7VSOIRHVSWV54QHCQXMMSTTMYJXCIRSUFY5TM7DRPB4FVJ45HA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:50168->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:50168->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50168->81.171.14.70:4026: use of closed network connection Sep 6 09:41:26.044752602 (187h33m22.724948181s) [noise=true , address=81.171.14.70:4045 , piece_id=6BG5RCX45JMCHTYH3PWTDI4WG3P62QB66RDPJNA4SAB5L73GYQTA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:39074->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:39074->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39074->81.171.14.70:4045: use of closed network connection Sep 6 09:41:26.044807998 (187h33m22.725003567s) [noise=true , address=185.167.204.205:4001 , piece_id=QN55RIBZC7FEZQWES66CRL2GA3PKT7ITNOQPUUAGD4OZD7OF4TNA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:38744->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:38744->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38744->185.167.204.205:4001: use of closed network connection Sep 6 09:41:26.044862603 (187h33m22.725058172s) [noise=true , address=185.167.204.206:4062 , piece_id=LNHOVJCAYDFGQZLICV4ND77QSF3PQO4ZN4FCDZQJU7BLA25E7QFQ, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: write tcp 188.166.225.170:47614->185.167.204.206:4062: use of closed network connection; write tcp 188.166.225.170:47614->185.167.204.206:4062: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47614->185.167.204.206:4062: use of closed network connection Sep 6 09:41:26.044871150 (187h33m22.725066709s) [noise=true , address=185.167.204.206:4070 , piece_id=7MZF6RGDKQVV2LNYSGYXLGFBGUU7THMXP5LR3V7HIUDFUVN7EMXA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: write tcp 188.166.225.170:34060->185.167.204.206:4070: use of closed network connection; write tcp 188.166.225.170:34060->185.167.204.206:4070: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34060->185.167.204.206:4070: use of closed network connection Sep 6 09:41:26.045032047 (187h33m22.725227636s) [noise=true , address=185.167.204.206:4049 , piece_id=C2VJ4TXTLXGT7LCK7TU2KYFOCRSA5HNBV5JUOPSXZUUHYKU4BPVA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:57816->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:57816->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57816->185.167.204.206:4049: use of closed network connection Sep 6 09:41:26.045086230 (187h33m22.725281799s) [noise=true , address=81.171.14.70:4030 , piece_id=H6ILWB7NE7KLQNEKF6IV3MH6NOUDS227QIKZFXBQ6U24RC4YUH4A, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: read tcp 188.166.225.170:54518->81.171.14.70:4030: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:41:26.045122130 (187h33m22.725317699s) [noise=true , address=81.171.14.70:4042 , piece_id=XFD55Z7KUZRFHOQL4XE3VOLE4IVQNQMVQB7HGHZJOFDG4HTHF2NQ, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:37010->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:37010->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37010->81.171.14.70:4042: use of closed network connection Sep 6 09:41:26.045212172 (187h33m22.725407761s) [noise=true , address=185.167.204.205:4016 , piece_id=VF3WNNVP6G6RPZM4COVLWVNRROVRDVUWNCDD5APZQXAE45SQOUVA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 188.166.225.170:52008->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:41:26.045252359 (187h33m22.725447928s) [noise=true , address=81.171.14.70:4048 , piece_id=2CDLZJPISE4S4XME5YOPVT4FXXNLRMVANULAHR3G32BRS7LNECQA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: write tcp 188.166.225.170:54606->81.171.14.70:4048: use of closed network connection; write tcp 188.166.225.170:54606->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54606->81.171.14.70:4048: use of closed network connection Sep 6 09:41:26.045258411 (187h33m22.72545399s) [noise=true , address=185.167.204.206:4052 , piece_id=HGKPHLK76JMMDSDNBVOEY3J7U7EBQQJYU27HHM7UUOWDGALQXX4Q, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: read tcp 188.166.225.170:56322->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:41:26.045313105 (187h33m22.725508674s) [noise=true , address=81.171.14.70:4047 , piece_id=BWAME7VJAN2LXJJNF6YDIIHCGI6BZML6X3S7BXFFCTJR7X7RUAIA, seg_pos={0 0}, upload=165019]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:40776->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:41:26.045349685 (187h33m22.725545254s) [seg_pos={0 0}, upload=165019]: Done waiting for segment. successful: 7 optimal: 26 errs: <nil> Sep 6 09:41:26.216556936 (187h33m22.896752515s) [upload=165019]: Done uploading segments... Sep 6 09:41:26.216590601 (187h33m22.89678617s) [upload=165019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 7) Duration: 1m0.174364112s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX] duration: 30.000345227s FAIL (2025-09-06 09:41:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000365044s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 18 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXX...XXXXXX..] duration: 22.894649096s FAIL (2025-09-06 09:41:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 22.894673391s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 6 out of 60 is failed (threshold=3) [....................................X..X....X.X........X.X..] duration: 5.484365785s FAIL (2025-09-06 09:41:21 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 43) Duration: 5.484393328s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 30.00061843s FAIL (2025-09-06 09:41:19 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 30.000640201s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 15 out of 60 is failed (threshold=3) [.....................................XXXXXX.....XXX.X.X.XXXX] duration: 30.00130347s FAIL (2025-09-06 09:41:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:40:55.687477176 (187h32m52.367672745s) [upload=165027]: Starting upload Sep 6 09:40:55.687529276 (187h32m52.367724835s) [upload=165027]: Done starting upload Sep 6 09:40:55.687623947 (187h32m52.367819516s) [upload=165027]: Uploading segments... Sep 6 09:40:55.687661369 (187h32m52.367856938s) [upload=165027]: Got next segment. Inline: true Sep 6 09:40:55.687665246 (187h32m52.367860815s) [upload=165027]: Waiting for error group managing segments... Sep 6 09:40:55.687720752 (187h32m52.367916321s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:40:55.687725201 (187h32m52.36792077s) [upload=165027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:40:55.687728007 (187h32m52.367923576s) [upload=165027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:41:17.325212667 (187h33m14.005408236s) [upload=165027]: Done uploading segments... Sep 6 09:41:17.325231412 (187h33m14.005426981s) [upload=165027]: Upload finished. err: <nil> Duration:* 30.00132416s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [..................................................X.X..X.XX.] duration: 7.655249775s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:41:14 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 7.655284061s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [........................................XXX....X.XX..X......] duration: 4.465197247s target: https://us1.storj.io/login FAIL (2025-09-06 09:41:10 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 4.465220903s core satellite us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [............................................X..X..X..X.X....] duration: 5.263181722s FAIL (2025-09-06 09:41:08 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 5.263206067s edge authservice http us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 3.979748262s FAIL (2025-09-06 09:41:06 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 3.979774361s core uplink ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration: 1m0.001664559s FAIL (2025-09-06 09:41:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001677213s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration: 31.41153568s FAIL (2025-09-06 09:40:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== . Sep 6 09:40:42.312138299 (187h32m38.992333888s) [noise=true , address=45.91.116.9:4261 , piece_id=FHKP4PVV5WGJ3UTAV6CB4FNEFHGUBJW2N43SX7XL7L6IYHIET3MA, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.312424907 (187h32m38.992620516s) [noise=true , address=45.91.116.10:4083 , piece_id=TS5TMH2P63IWEVIVSHI7V44K6EO4CGIP4S2N2WI325OT74GP2BAQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.312769547 (187h32m38.992965136s) [noise=true , address=77.90.31.14:4663 , piece_id=7UDQXW5DIRFBNHEGWDABEKPMNZYQPRPIEGNWZ4HXCOORJARWBTXQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.312873907 (187h32m38.993069486s) [noise=true , address=45.91.116.13:4153 , piece_id=ZWWOQVF6D2AZIKZ436G6ESCNE5KUYEDYXMSVHNPEYKVOQBZUWCVQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.313323266 (187h32m38.993518836s) [noise=true , address=45.91.116.14:4189 , piece_id=JVMQGZKVEOXUXC7QNFC4H7SG3WZJWLVJMD3GVXWTZJPH74JKFVSQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.313336212 (187h32m38.993531781s) [noise=true , address=77.90.31.19:4843 , piece_id=HKOXHRCJ7ZDC3YGWQ43XL3LV2YNUXZVIEZTFDPGDQXZLHVA6VNFQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.313681141 (187h32m38.99387672s) [noise=true , address=45.91.116.11:4117 , piece_id=3ZGPKCLEVO4HF7MKYQG2OCCZQAQH5E6VLAJ3MEZKZBY4JB35V4TQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.313764310 (187h32m38.993959879s) [noise=true , address=45.91.116.6:4974 , piece_id=WXTP4GMBD6D25B67GBX4IZBJJGOVFJ3UQNTMG5NWO4IAC7LLPBOA, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.318076792 (187h32m38.998272372s) [noise=true , address=45.91.116.9:4262 , piece_id=O5OGHXRXT6VX5Z3PSGE6YDSYJPNKFKMQ5ZODBWCBPDNG3GE63MPQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:42.318474564 (187h32m38.998670133s) [noise=true , address=77.90.31.17:4772 , piece_id=7D2T4CHVTHU3QOGP37OIITDJBRGEI2JVHB3TZCPWXPMC2ZEUGDQQ, seg_pos={0 0}, upload=165023]: Uploading piece... Sep 6 09:40:53.037290472 (187h32m49.717486051s) [upload=165023]: Next segment err: context deadline exceeded Sep 6 09:40:53.038044114 (187h32m49.718239683s) [noise=true , address=45.91.116.9:4261 , piece_id=FHKP4PVV5WGJ3UTAV6CB4FNEFHGUBJW2N43SX7XL7L6IYHIET3MA, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: read tcp 188.166.225.170:52486->45.91.116.9:4261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038087086 (187h32m49.718282655s) [noise=true , address=77.90.31.17:4772 , piece_id=7D2T4CHVTHU3QOGP37OIITDJBRGEI2JVHB3TZCPWXPMC2ZEUGDQQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: rpc: dial tcp 77.90.31.17:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038195994 (187h32m49.718391563s) [noise=true , address=77.90.31.14:4663 , piece_id=7UDQXW5DIRFBNHEGWDABEKPMNZYQPRPIEGNWZ4HXCOORJARWBTXQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 188.166.225.170:40590->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038276368 (187h32m49.718471937s) [noise=true , address=45.91.116.6:4975 , piece_id=3B7DWJIY3UMZSRBW4ND677F3SVLRQTDFBLO6KPDOKAOTOGWN7KBA, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: read tcp 188.166.225.170:52906->45.91.116.6:4975: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038308419 (187h32m49.718503988s) [noise=true , address=77.90.31.21:4878 , piece_id=I7RHIMXSXSSVOWYWTJ2TMSIOXDZOTMEGAGXQKYDT6MZNON42YFNQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: read tcp 188.166.225.170:40932->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038339510 (187h32m49.718535079s) [noise=true , address=77.90.31.10:4519 , piece_id=UEUJDKNYC7OB7BXZLGXSYVSG4P7TKRYK6FY6PNGGWET2WZEPUZQA, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: read tcp 188.166.225.170:51380->77.90.31.10:4519: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038392991 (187h32m49.71858856s) [noise=true , address=45.91.116.11:4118 , piece_id=6Y3HIIRIO7RAH5ZNHUPRQT5DWUEIA5CNUHCIABCEMYBKND47NPYA, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 188.166.225.170:36788->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038431595 (187h32m49.718627164s) [noise=true , address=45.91.116.14:4189 , piece_id=JVMQGZKVEOXUXC7QNFC4H7SG3WZJWLVJMD3GVXWTZJPH74JKFVSQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 188.166.225.170:33236->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038475389 (187h32m49.718670958s) [noise=true , address=45.91.116.9:4262 , piece_id=O5OGHXRXT6VX5Z3PSGE6YDSYJPNKFKMQ5ZODBWCBPDNG3GE63MPQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 188.166.225.170:36320->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038510597 (187h32m49.718706156s) [noise=true , address=45.91.116.6:4974 , piece_id=WXTP4GMBD6D25B67GBX4IZBJJGOVFJ3UQNTMG5NWO4IAC7LLPBOA, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: read tcp 188.166.225.170:33202->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038545563 (187h32m49.718741132s) [noise=true , address=45.91.116.10:4083 , piece_id=TS5TMH2P63IWEVIVSHI7V44K6EO4CGIP4S2N2WI325OT74GP2BAQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: read tcp 188.166.225.170:35342->45.91.116.10:4083: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038576041 (187h32m49.718771611s) [noise=true , address=45.91.116.7:4009 , piece_id=N5VOQY4LIFTOVXCMBDP6ANWB5VLGSQJUFNBGFO7NVKLQ5E7SCBFQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 188.166.225.170:33492->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038586622 (187h32m49.718782191s) [noise=true , address=45.91.116.13:4153 , piece_id=ZWWOQVF6D2AZIKZ436G6ESCNE5KUYEDYXMSVHNPEYKVOQBZUWCVQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: read tcp 188.166.225.170:47752->45.91.116.13:4153: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038632059 (187h32m49.718827638s) [noise=true , address=77.90.31.19:4842 , piece_id=LOXBRQMSLNAYL25U7NE6PA5R4GXXXALIE6DOVXOLAQWD2DKBV62A, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:58448->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038658509 (187h32m49.718854078s) [noise=true , address=77.90.31.19:4843 , piece_id=HKOXHRCJ7ZDC3YGWQ43XL3LV2YNUXZVIEZTFDPGDQXZLHVA6VNFQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: read tcp 188.166.225.170:33560->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038667748 (187h32m49.718863327s) [noise=true , address=45.91.116.11:4117 , piece_id=3ZGPKCLEVO4HF7MKYQG2OCCZQAQH5E6VLAJ3MEZKZBY4JB35V4TQ, seg_pos={0 0}, upload=165023]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:38884->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:53.038685180 (187h32m49.718880749s) [seg_pos={0 0}, upload=165023]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 31.411559727s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration: 1m29.156635392s FAIL (2025-09-06 09:40:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== (187h32m20.410617922s) [upload=165009]: Next segment err: context deadline exceeded Sep 6 09:40:23.730581487 (187h32m20.410777056s) [noise=true , address=145.79.227.16:4931 , piece_id=H4OEMTGOL7E4XDFCR44CYUWUXZV2CLML7V4JNJKWSW5ZFSNCNNDA, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:125rm4HueKsNdwL3eCTCSWoPseR2LQWcsE3jNPpxSfYQQorj9LL, address:145.79.227.16:4931): protocol: write tcp 188.166.225.170:54054->145.79.227.16:4931: use of closed network connection; write tcp 188.166.225.170:54054->145.79.227.16:4931: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54054->145.79.227.16:4931: use of closed network connection Sep 6 09:40:23.730623197 (187h32m20.410818766s) [noise=true , address=145.79.227.18:4035 , piece_id=VXQFLUOXH7PJFGMCWTLAMEL6NQQPBLWQTJURQ74EBNCL6F7CTUVA, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:1vucBTonz7hjJgo2Jy2rhpSryqK6ifrBtj34pAcqc8FA5nPyYp, address:145.79.227.18:4035): protocol: write tcp 188.166.225.170:42590->145.79.227.18:4035: use of closed network connection; write tcp 188.166.225.170:42590->145.79.227.18:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42590->145.79.227.18:4035: use of closed network connection Sep 6 09:40:23.730638737 (187h32m20.410834296s) [noise=true , address=145.79.227.14:4842 , piece_id=FJ3UITBSIVRV6UNT4K4HSXJSLK25R3MOBMH7K4KP3XRBCEHM5JLQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn, address:145.79.227.14:4842): protocol: read tcp 188.166.225.170:58654->145.79.227.14:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:23.730665709 (187h32m20.410861278s) [noise=true , address=145.79.227.30:4761 , piece_id=B57GD2YCYTBV4ZJSWOHYIRWFTKHRIPHES4IJGN22GW6VEGNHVL6A, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12aik37v1FXxLLPx5EoA5EWszHVsRUz7kAriBYUbWEtN15555xE, address:145.79.227.30:4761): protocol: write tcp 188.166.225.170:48566->145.79.227.30:4761: use of closed network connection; write tcp 188.166.225.170:48566->145.79.227.30:4761: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48566->145.79.227.30:4761: use of closed network connection Sep 6 09:40:23.730698261 (187h32m20.41089383s) [noise=true , address=145.79.227.4:4211 , piece_id=5WZFOFATZNHAQWHM7EXIA7U4I4EQRV4AKH6CHSZX3VA76YDO52OQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12dANoYTygpcpWfCcAJtsnVBFWSekLhDjheAXnsaYMChRYAm2qc, address:145.79.227.4:4211): protocol: read tcp 188.166.225.170:44386->145.79.227.4:4211: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:23.730732296 (187h32m20.410927855s) [noise=true , address=45.91.116.5:4305 , piece_id=S6ZQPVMTXELHTZ4JU5UQB5L2LIMKOFMUJ6GQGTPWAGUS56V2YXEQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1, address:45.91.116.5:4305): protocol: read tcp 188.166.225.170:41044->45.91.116.5:4305: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:23.730782883 (187h32m20.410978452s) [noise=true , address=145.79.227.48:4303 , piece_id=AF2TY5XI7GQAO7MYPYV6S22SUJPAEJX6WGNKJOJE6MV5RIJV7W4Q, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12gJKrCBLJWN1SBKibfeqBtcqqiv4veKTGmtnycjZyb3VN9kwoT, address:145.79.227.48:4303): protocol: write tcp 188.166.225.170:56092->145.79.227.48:4303: use of closed network connection; write tcp 188.166.225.170:56092->145.79.227.48:4303: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->145.79.227.48:4303: use of closed network connection Sep 6 09:40:23.730830184 (187h32m20.411025753s) [noise=true , address=145.79.227.49:4340 , piece_id=DJRW7DWM74RQNWWLK4AZZTGYR6MWSA2OVJCZQZDHTZHWZRYGMO7Q, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC, address:145.79.227.49:4340): protocol: write tcp 188.166.225.170:60350->145.79.227.49:4340: use of closed network connection; write tcp 188.166.225.170:60350->145.79.227.49:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60350->145.79.227.49:4340: use of closed network connection Sep 6 09:40:23.730885690 (187h32m20.411081249s) [noise=true , address=145.79.227.24:4591 , piece_id=BT4P3377ELAW7RYNU3IM4IQ7AOCLEYOS5AVDBF27AHGL7NLTQQLQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12a453d6xSb26epbgqPuco3UPTf9yzoxBeKToCUMNiNHUddAq55, address:145.79.227.24:4591): protocol: write tcp 188.166.225.170:57542->145.79.227.24:4591: use of closed network connection; write tcp 188.166.225.170:57542->145.79.227.24:4591: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57542->145.79.227.24:4591: use of closed network connection Sep 6 09:40:23.730897752 (187h32m20.411093321s) [noise=true , address=45.91.116.7:4027 , piece_id=6W54NXJDBF74SH4MUXGJJGMQICVO6DJCEO7TIZH2GFM5DLXTEHQQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12BQKHUMVYD7qDZW45LNEfgnkLVoSneDrQXViaMvcvAPdfmheMq, address:45.91.116.7:4027): protocol: write tcp 188.166.225.170:49950->45.91.116.7:4027: use of closed network connection; write tcp 188.166.225.170:49950->45.91.116.7:4027: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49950->45.91.116.7:4027: use of closed network connection Sep 6 09:40:23.730927018 (187h32m20.411122577s) [noise=true , address=145.79.227.52:4476 , piece_id=RXGPP3OUYS7U6IWLEKCK6J7NA2ZHJK4QVSUZOTFTA3J7MITHHHSA, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV, address:145.79.227.52:4476): protocol: write tcp 188.166.225.170:46362->145.79.227.52:4476: use of closed network connection; write tcp 188.166.225.170:46362->145.79.227.52:4476: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46362->145.79.227.52:4476: use of closed network connection Sep 6 09:40:23.730966675 (187h32m20.411162244s) [noise=true , address=145.79.227.37:4572 , piece_id=CWDWH3CLEPN4BRDPIAI4F3SPH7AWE7RULWTRLRCZXS6KRYH2CMXA, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12381Fn7xsobroApDcM4WbkuUzkZZJXw3VQDZpLMJog1dotdo3t, address:145.79.227.37:4572): protocol: write tcp 188.166.225.170:54522->145.79.227.37:4572: use of closed network connection; write tcp 188.166.225.170:54522->145.79.227.37:4572: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54522->145.79.227.37:4572: use of closed network connection Sep 6 09:40:23.730989778 (187h32m20.411185347s) [noise=true , address=45.91.116.6:4003 , piece_id=7EWKGN62S3YM2CEXQJF5XWQQZCFYPNBM75RVLIIHVX4TW7BAUYLQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:1veqoBGw6a8AGMoigyuNJMjcEvCT93xRq2B1d2KNhs6aEmSqVF, address:45.91.116.6:4003): protocol: read tcp 188.166.225.170:41236->45.91.116.6:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:23.731023864 (187h32m20.411219423s) [noise=true , address=77.90.31.17:4803 , piece_id=JNVW3DDVVNUXHOOLROR6WSELZCE6C6OVGXAM4ZTAA7YXPISXC2NQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12onacKUY32faZTFuyEjvMCZA4nVKiRKmTKh1WRFMfif2Kw1Q7Y, address:77.90.31.17:4803): protocol: read tcp 188.166.225.170:34472->77.90.31.17:4803: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:23.731033322 (187h32m20.411228891s) [noise=true , address=45.91.116.10:4114 , piece_id=P4J2VE3WCUD6CZRMTDF2ZAY2T3VNWKHJOWEELUYZWTHYKMWFM4YQ, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:121wUjWPiPFgX5PLRcNrs535zEL81fbPpquD9rhSaqkpWxjGZLY, address:45.91.116.10:4114): protocol: write tcp 188.166.225.170:50786->45.91.116.10:4114: use of closed network connection; write tcp 188.166.225.170:50786->45.91.116.10:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50786->45.91.116.10:4114: use of closed network connection Sep 6 09:40:23.731045435 (187h32m20.411241004s) [noise=true , address=145.79.227.3:4167 , piece_id=LZOTDIAPMOR7MVN54GK52C4GV3XN542OHVZOYMISY4B6XSIHTG2A, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:12sGc7qmx3smXoPkf6zMMt57V8VhF1kHaPhExKCe873fEm9yUih, address:145.79.227.3:4167): protocol: read tcp 188.166.225.170:43600->145.79.227.3:4167: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:23.731051156 (187h32m20.411246715s) [noise=true , address=45.91.116.4:4946 , piece_id=2MHAEIBGNIYT4DSMIH26U3BIUYBULFTHG5RFO4BJRI47VK3YXADA, seg_pos={0 0}, upload=165009]: Done uploading piece. err: ecclient: upload failed (node:18tmori7tiA7FvTDd5MXLX7F2DoAxg3QFNtZHwCMnVtgwP7uve, address:45.91.116.4:4946): protocol: write tcp 188.166.225.170:49042->45.91.116.4:4946: use of closed network connection; write tcp 188.166.225.170:49042->45.91.116.4:4946: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49042->45.91.116.4:4946: use of closed network connection Sep 6 09:40:23.731064702 (187h32m20.411260271s) [seg_pos={0 0}, upload=165009]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m29.156657525s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [.............................................XX...XX....XXXX] duration: 1m0.000641084s FAIL (2025-09-06 09:40:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:40:03.132906827 (187h31m59.813102396s) [upload=165017]: Starting upload Sep 6 09:40:03.132979777 (187h31m59.813175356s) [upload=165017]: Done starting upload Sep 6 09:40:03.133037107 (187h31m59.813232676s) [upload=165017]: Uploading segments... Sep 6 09:40:03.133078547 (187h31m59.813274126s) [upload=165017]: Got next segment. Inline: true Sep 6 09:40:03.133083235 (187h31m59.813278814s) [upload=165017]: Waiting for error group managing segments... Sep 6 09:40:03.133126047 (187h31m59.813321626s) [upload=165017]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:40:03.133131979 (187h31m59.813327558s) [upload=165017]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:40:03.133134964 (187h31m59.813330534s) [upload=165017]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:40:52.986772975 (187h32m49.666968544s) [upload=165017]: Done uploading segments... Sep 6 09:40:52.986797041 (187h32m49.66699261s) [upload=165017]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1m0.000652947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.....................................X..X....X.X........X.X.] duration: 5.727953949s FAIL (2025-09-06 09:40:51 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 43) Duration: 5.727976363s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.....................................X.X.X.X.XX.XXX.X..X...X] duration: 30.000486098s FAIL (2025-09-06 09:40:47 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.000502359s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 6 out of 60 is failed (threshold=3) [......................................X..X....X.X........X.X] duration: 30.180565045s FAIL (2025-09-06 09:40:45 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 43) Duration: 30.180595474s core uplink eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [.........................................XXX....X.XX..X.....] duration: 24.432325747s target: https://us1.storj.io/login FAIL (2025-09-06 09:40:43 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 24.432344243s core satellite us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [...................................................X.X..X.XX] duration: 30.001440693s target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:40:30 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 30.001469807s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration: 30.000583162s FAIL (2025-09-06 09:40:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000601447s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 31.390331987s FAIL (2025-09-06 09:40:20 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 44) Duration: 31.390358117s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [......................................X.X.X.X.XX.XXX.X..X...] duration: 19.188980538s FAIL (2025-09-06 09:40:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 19.189006107s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [..........................................XXX....X.XX..X....] duration: 12.961598451s target: https://us1.storj.io/login FAIL (2025-09-06 09:40:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 12.961656811s core satellite us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 829.781649ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:40:14 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 829.810054ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration: 1m0.173273494s FAIL (2025-09-06 09:40:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 12) ======LOGS====== address=89.149.201.147:4010 , piece_id=BW3AOJZFWXSY4BSVUJ7XRBD4MJQEMUICWZO5QXZBMF7LCLX4ZWOQ, seg_pos={0 0}, upload=165006]: Done uploading piece. err: <nil> Sep 6 09:39:15.796961720 (187h31m12.477157289s) [noise=true , address=89.149.201.147:4015 , piece_id=KOWU3MIAAHJ63WU36WRIFNJHXZNGDKMMXST5CUOEMPF7ZA3RMYRQ, seg_pos={0 0}, upload=165006]: Done uploading piece. err: <nil> Sep 6 09:40:13.183505218 (187h32m9.863700787s) [noise=true , address=185.167.204.205:4032 , piece_id=I6IMPSLZDTE2UYZZCUJJ7EJGX3UPBLAAMN43CCD5FN34N6JZLWPA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: expected piece hash; context deadline exceeded; EOF Sep 6 09:40:13.183800613 (187h32m9.863996192s) [noise=true , address=81.171.14.70:4025 , piece_id=2UZX7EWXQSUGMJBUUJNLGKHXIAQFFD3TRBQMSBKLD6NJOLFDVEDA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:47544->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:47544->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47544->81.171.14.70:4025: use of closed network connection Sep 6 09:40:13.183845779 (187h32m9.864041358s) [noise=true , address=185.167.204.205:4014 , piece_id=BDUCLHFLBJQCC3KKD4MYQIZSXAAGHUYTS76BCLFTDWT2T6YIDMSA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 188.166.225.170:45470->185.167.204.205:4014: use of closed network connection; write tcp 188.166.225.170:45470->185.167.204.205:4014: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45470->185.167.204.205:4014: use of closed network connection Sep 6 09:40:13.183893070 (187h32m9.864088639s) [noise=true , address=81.171.14.70:4033 , piece_id=P6UDOKKOIWXDKH2LYKQHYUZ5SFFH6ETA5VEHI7HSRMIMBFRFMBAA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51168->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51168->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51168->81.171.14.70:4033: use of closed network connection Sep 6 09:40:13.183934990 (187h32m9.864130559s) [noise=true , address=81.171.14.70:4046 , piece_id=IZ4ZSAL2PCP637FHDU5XHAUDFXN2XYOTAKTDQUOOPMLDIUGSIPRQ, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:53714->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:53714->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53714->81.171.14.70:4046: use of closed network connection Sep 6 09:40:13.183987972 (187h32m9.864183541s) [noise=true , address=185.167.204.205:4012 , piece_id=LVWDQZRQREUD3MQZVYYXK7JMPHTE5BMXKHTUGN4BJBSFCRYU2XIA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:34550->185.167.204.205:4012: use of closed network connection; write tcp 188.166.225.170:34550->185.167.204.205:4012: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34550->185.167.204.205:4012: use of closed network connection Sep 6 09:40:13.184022397 (187h32m9.864217966s) [noise=true , address=81.171.14.70:4038 , piece_id=V67MY64A6PEZ33P7UE3JWQJQNJ5ECZ7QGWLEHSQDG2JNZEDHUKBA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:47242->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:47242->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47242->81.171.14.70:4038: use of closed network connection Sep 6 09:40:13.184063385 (187h32m9.864258954s) [noise=true , address=81.171.14.70:4045 , piece_id=HOFAA2IULDOLONKFUJKN4ROQSZOEAHAKYBHBZ6XKNPGIHAWJH7UA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:48816->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:48816->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48816->81.171.14.70:4045: use of closed network connection Sep 6 09:40:13.184128200 (187h32m9.864323769s) [noise=true , address=185.167.204.206:4047 , piece_id=2C7TWBAPSUSP2NMCPY6AA67APOTEK6VRQHF72N5H7BHLJWBQX7EA, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF, address:185.167.204.206:4047): protocol: read tcp 188.166.225.170:56474->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:13.184209235 (187h32m9.864404804s) [noise=true , address=185.167.204.206:4067 , piece_id=M65MJ527OHVBHX7RLMC4E5Z22XHJQOSNFWQXMBVO4ASAHRFKBG4Q, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: write tcp 188.166.225.170:55548->185.167.204.206:4067: use of closed network connection; write tcp 188.166.225.170:55548->185.167.204.206:4067: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55548->185.167.204.206:4067: use of closed network connection Sep 6 09:40:13.184265984 (187h32m9.864461553s) [noise=true , address=185.167.204.206:4049 , piece_id=EHJABJR3BH5N466DVI7RPJ2WMJO5KAURC2E65VCNQSCEEMUTYP3Q, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: read tcp 188.166.225.170:57864->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:13.184281813 (187h32m9.864477382s) [noise=true , address=185.167.204.206:4048 , piece_id=6WYHSPEPZ24CKJSQC7MQ3KWT5KOYZFPTPZXCVMLN6SQX4MYXI2GQ, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1sY4wHBkSVUDWWg8T8Vm1hpRbbpb3ttqnqDVY8uWyG27gqBwT9, address:185.167.204.206:4048): protocol: write tcp 188.166.225.170:51824->185.167.204.206:4048: use of closed network connection; write tcp 188.166.225.170:51824->185.167.204.206:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51824->185.167.204.206:4048: use of closed network connection Sep 6 09:40:13.184292434 (187h32m9.864488003s) [noise=true , address=81.171.14.70:4047 , piece_id=5USCGHXJ5VQOQ3LEBFQMX7G53QQMUP6IFT66WCAFLOGRKLU4UQEQ, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:33284->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:33284->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33284->81.171.14.70:4047: use of closed network connection Sep 6 09:40:13.184308985 (187h32m9.864504554s) [noise=true , address=185.167.204.205:4030 , piece_id=J43BE43SI5PLALPDEUE2GTLLQF2TJGBGCFYORBDUIN7DS5PWEGLQ, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: write tcp 188.166.225.170:47310->185.167.204.205:4030: use of closed network connection; write tcp 188.166.225.170:47310->185.167.204.205:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47310->185.167.204.205:4030: use of closed network connection Sep 6 09:40:13.184347991 (187h32m9.86454356s) [noise=true , address=185.167.204.206:4070 , piece_id=3VG5TA5VMJLBKVLOL52YJK67WNI6ZF5NJNC3SFI6Y4IDJON2FE2A, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: read tcp 188.166.225.170:34458->185.167.204.206:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:13.184372598 (187h32m9.864568167s) [noise=true , address=81.171.14.70:4040 , piece_id=N5X46TXSVYBMVCPNY7R3ZD3ABFOPAQJNX7YG3EXRH6KGUDQLU67A, seg_pos={0 0}, upload=165006]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:48882->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:40:13.184412764 (187h32m9.864608333s) [seg_pos={0 0}, upload=165006]: Done waiting for segment. successful: 12 optimal: 26 errs: <nil> Sep 6 09:40:13.355574829 (187h32m10.035770399s) [upload=165006]: Done uploading segments... Sep 6 09:40:13.355603224 (187h32m10.035798783s) [upload=165006]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 12) Duration: 1m0.173295195s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 14 out of 60 is failed (threshold=3) [......................................XXXXXX.....XXX.X.X.XXX] duration: 30.000987524s FAIL (2025-09-06 09:40:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:39:48.622092711 (187h31m45.30228828s) [upload=165012]: Starting upload Sep 6 09:39:48.622168777 (187h31m45.302364346s) [upload=165012]: Done starting upload Sep 6 09:39:48.622280551 (187h31m45.30247612s) [upload=165012]: Uploading segments... Sep 6 09:39:48.622319084 (187h31m45.302514653s) [upload=165012]: Got next segment. Inline: true Sep 6 09:39:48.622322993 (187h31m45.302518562s) [upload=165012]: Waiting for error group managing segments... Sep 6 09:39:48.622355765 (187h31m45.302551344s) [upload=165012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:39:48.622360113 (187h31m45.302555682s) [upload=165012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:39:48.622362638 (187h31m45.302558207s) [upload=165012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:39:49.370556676 (187h31m46.050752246s) [upload=165012]: Done uploading segments... Sep 6 09:39:49.370575383 (187h31m46.050770952s) [upload=165012]: Upload finished. err: <nil> Duration:* 30.001009176s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 18 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXX...XXXXXX.] duration: 10.364388679s FAIL (2025-09-06 09:40:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.364445037s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration: 1m0.000688934s FAIL (2025-09-06 09:40:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000705947s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [....................................................X.X..X.X] duration: 2m0.001059915s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-09-06 09:40:00 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2m0.001079905s edge gateway vhost us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 3.000212844s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:39:59 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 3.000237992s edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX] duration: 30.001411777s FAIL (2025-09-06 09:39:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 6 09:39:40.289126687 (187h31m36.969322266s) [upload=165011]: Starting upload Sep 6 09:39:40.289208945 (187h31m36.969404514s) [upload=165011]: Done starting upload Sep 6 09:39:40.289408706 (187h31m36.969604276s) [upload=165011]: Uploading segments... Sep 6 09:39:40.289525490 (187h31m36.969721069s) [upload=165011]: Got next segment. Inline: false Sep 6 09:39:40.289562019 (187h31m36.969757588s) [upload=165011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:39:40.289567511 (187h31m36.96976308s) [upload=165011]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 6 09:39:58.026603237 (187h31m54.706798817s) [upload=165011]: Next segment err: context deadline exceeded Sep 6 09:39:58.026727435 (187h31m54.706923004s) [upload=165011]: Done uploading segments... Sep 6 09:39:58.026741422 (187h31m54.706936991s) [upload=165011]: Upload finished. err: context deadline exceeded Duration: 30.001431976s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.752661102s FAIL (2025-09-06 09:39:57 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 46) Duration: 3.752690167s core uplink ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [.............................................X..X..X..X.X...] duration: 4.955752866s FAIL (2025-09-06 09:39:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 4.955783315s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 7 out of 60 is failed (threshold=3) [..............................................XX...XX....XXX] duration: 1m0.001383342s FAIL (2025-09-06 09:39:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:38:55.935799589 (187h30m52.615995158s) [upload=165003]: Starting upload Sep 6 09:38:55.935853643 (187h30m52.616049202s) [upload=165003]: Done starting upload Sep 6 09:38:55.935915872 (187h30m52.616111441s) [upload=165003]: Uploading segments... Sep 6 09:38:55.935978241 (187h30m52.61617381s) [upload=165003]: Got next segment. Inline: true Sep 6 09:38:55.935984963 (187h30m52.616180532s) [upload=165003]: Waiting for error group managing segments... Sep 6 09:38:55.936026002 (187h30m52.616221571s) [upload=165003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:38:55.936030340 (187h30m52.616225899s) [upload=165003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:38:55.936032855 (187h30m52.616228424s) [upload=165003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:39:34.858033239 (187h31m31.538228818s) [upload=165003]: Done uploading segments... Sep 6 09:39:34.858053247 (187h31m31.538248816s) [upload=165003]: Upload finished. err: <nil> Duration:* 1m0.001394923s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [...........................................XXX....X.XX..X...] duration: 7.76602446s target: https://us1.storj.io/login FAIL (2025-09-06 09:39:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 7.766056242s core satellite us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 42.589792508s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-09-06 09:39:45 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout Duration: 42.589816825s edge linksharing us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................X..X....X.X........X.] duration: 5.782437921s FAIL (2025-09-06 09:39:42 UTC) orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 49 but got 47) Duration: 5.782472247s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [.......................................X.X.X.X.XX.XXX.X..X..] duration: 16.169238274s FAIL (2025-09-06 09:39:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 16.169262832s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration: 10.469196796s FAIL (2025-09-06 09:39:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.469222624s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 18 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXX...XXXXXX] duration: 30.001051596s FAIL (2025-09-06 09:39:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001062326s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [..............................................X..X..X..X.X..] duration: 46.591033766s FAIL (2025-09-06 09:39:34 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout Duration: 46.591064354s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 53.728385262s FAIL (2025-09-06 09:39:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 53.728409418s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [............................................XXX....X.XX..X..] duration: 4.268634155s target: https://us1.storj.io/login FAIL (2025-09-06 09:39:25 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 4.268658653s core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 7 out of 60 is failed (threshold=3) [.............................................XXX....X.XX..X.] duration: 42.254085325s target: https://us1.storj.io/login FAIL (2025-09-06 09:39:17 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: i/o timeout Duration: 42.25412405s core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 13 out of 60 is failed (threshold=3) [.......................................XXXXXX.....XXX.X.X.XX] duration: 30.000611759s FAIL (2025-09-06 09:39:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 6 09:38:47.028247222 (187h30m43.708442801s) [upload=165001]: Starting upload Sep 6 09:38:47.028388403 (187h30m43.708583972s) [upload=165001]: Done starting upload Sep 6 09:38:47.028521758 (187h30m43.708717337s) [upload=165001]: Uploading segments... Sep 6 09:38:47.028572565 (187h30m43.708768134s) [upload=165001]: Got next segment. Inline: true Sep 6 09:38:47.028577564 (187h30m43.708773133s) [upload=165001]: Waiting for error group managing segments... Sep 6 09:38:47.028639003 (187h30m43.708834572s) [upload=165001]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 6 09:38:47.028645234 (187h30m43.708840803s) [upload=165001]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 6 09:38:47.028648661 (187h30m43.70884423s) [upload=165001]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 6 09:38:49.397906939 (187h30m46.078102508s) [upload=165001]: Done uploading segments... Sep 6 09:38:49.397927288 (187h30m46.078122857s) [upload=165001]: Upload finished. err: <nil> Duration:* 30.000632089s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration: 1m2.368698869s FAIL (2025-09-06 09:39:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== .79.227.37:4597: use of closed network connection; write tcp 188.166.225.170:54550->145.79.227.37:4597: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54550->145.79.227.37:4597: use of closed network connection Sep 6 09:39:08.914375086 (187h31m5.594570655s) [noise=true , address=145.79.227.35:4504 , piece_id=LYSFM6RVSPPIEWVIP3NUNUO7LSV2HONCIS5UP4OF2MGKDTUA3UBA, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1diUXMdXuNQNtEv5rYhk8sKkN3uQQCahjp9hQLTgRCknQ3B7D9, address:145.79.227.35:4504): protocol: write tcp 188.166.225.170:56190->145.79.227.35:4504: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.35:4504: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.35:4504: use of closed network connection Sep 6 09:39:08.914411806 (187h31m5.594607375s) [noise=true , address=45.91.116.9:4293 , piece_id=UFBF6ASZCSMVF43DUHQUELX6XDVUKFT5GPLX5RWFMEK5K663FZ6Q, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1XMXDwZP5R7ZZGr8x57g3faasnxk7YJiLeBSEodBeCP3mnPuRG, address:45.91.116.9:4293): protocol: write tcp 188.166.225.170:50354->45.91.116.9:4293: use of closed network connection; write tcp 188.166.225.170:50354->45.91.116.9:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50354->45.91.116.9:4293: use of closed network connection Sep 6 09:39:08.914447034 (187h31m5.594642593s) [noise=true , address=145.79.227.2:4125 , piece_id=LDYDHPGNEUWS5ERTYR3EPBXLGZVTL34L4ULRG463TDSC5EEMG6FQ, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:145.79.227.2:4125): protocol: write tcp 188.166.225.170:55988->145.79.227.2:4125: use of closed network connection; write tcp 188.166.225.170:55988->145.79.227.2:4125: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55988->145.79.227.2:4125: use of closed network connection Sep 6 09:39:08.914483965 (187h31m5.594679534s) [noise=true , address=45.91.116.8:4072 , piece_id=G5QYG5RVQ6ZITUVSVGHVT3MTUZZ46DBSISJ4QELGCKGNCPRNFDNQ, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1toupLRE5KrBcmqoVvKng6HZeybkwSzzrzwzqH3ZNukQEuEZWu, address:45.91.116.8:4072): protocol: write tcp 188.166.225.170:59822->45.91.116.8:4072: use of closed network connection; write tcp 188.166.225.170:59822->45.91.116.8:4072: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59822->45.91.116.8:4072: use of closed network connection Sep 6 09:39:08.914514062 (187h31m5.594709631s) [noise=true , address=77.90.31.17:4789 , piece_id=JFEFI7E5SDOADCLGGBTAPJQCQ7VR2ILMXCMJEIHGXNF2MBWMLFIQ, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: write tcp 188.166.225.170:47906->77.90.31.17:4789: use of closed network connection; write tcp 188.166.225.170:47906->77.90.31.17:4789: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47906->77.90.31.17:4789: use of closed network connection Sep 6 09:39:08.914530945 (187h31m5.594726514s) [noise=true , address=45.91.116.10:4114 , piece_id=37JSV6OMNC7XCGHDEC4FA2JJRC5MEZRCDRE26G7XTFAT4WSEETDQ, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:121wUjWPiPFgX5PLRcNrs535zEL81fbPpquD9rhSaqkpWxjGZLY, address:45.91.116.10:4114): protocol: write tcp 188.166.225.170:50000->45.91.116.10:4114: use of closed network connection; write tcp 188.166.225.170:50000->45.91.116.10:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50000->45.91.116.10:4114: use of closed network connection Sep 6 09:39:08.914546855 (187h31m5.594742424s) [noise=true , address=145.79.227.34:4916 , piece_id=ZYO5GPQQQV2OA7C2FMCXIZCSHCNHUZYXCGTQ76FDYGEW6LN6Q6SA, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:12sbCx4R1g3vGDnXQSARG3UD5pwzqUqkE1q37CUzn2skJftjLEa, address:145.79.227.34:4916): protocol: read tcp 188.166.225.170:45548->145.79.227.34:4916: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:08.914576491 (187h31m5.59477206s) [noise=true , address=145.79.227.52:4467 , piece_id=GWOETOYHYBDGWSZSKXNFUXNAC7SPMJH46KNVH3R6J2OFBZF54X6A, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1RegmCcGuZED5cPuhVJ9mLRuouCHBEZ3hecf7aseHsMCgo1ajT, address:145.79.227.52:4467): protocol: read tcp 188.166.225.170:42994->145.79.227.52:4467: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:08.914581160 (187h31m5.594776729s) [noise=true , address=77.90.31.13:4646 , piece_id=2OSIPCJDJXLGFO4QQ5GFKSCQTXPYAYFOLHC2FIP3S4EGDZVC6YUA, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5, address:77.90.31.13:4646): protocol: read tcp 188.166.225.170:50556->77.90.31.13:4646: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:08.914622810 (187h31m5.594818379s) [noise=true , address=145.79.227.45:4235 , piece_id=CT7TJOW4K7LXLUK4HPQ7S54LLCDEHXPLF6GK7QICAO5HEAFA3R4Q, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1a1sW1G1WPL5WQ2XxprWKQMsJkcb5ETSkk3ULp1TjRaZWptaT, address:145.79.227.45:4235): protocol: write tcp 188.166.225.170:47908->145.79.227.45:4235: use of closed network connection; write tcp 188.166.225.170:47908->145.79.227.45:4235: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47908->145.79.227.45:4235: use of closed network connection Sep 6 09:39:08.914631987 (187h31m5.594827557s) [noise=true , address=145.79.227.49:4349 , piece_id=GFH2KQZRKFYQ2QQOTZF4BRAE7OFMLUEE5EPRRUS6UGRDMOI7DOJA, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk, address:145.79.227.49:4349): protocol: write tcp 188.166.225.170:42044->145.79.227.49:4349: use of closed network connection; write tcp 188.166.225.170:42044->145.79.227.49:4349: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42044->145.79.227.49:4349: use of closed network connection Sep 6 09:39:08.914712151 (187h31m5.59490771s) [noise=true , address=145.79.227.41:4088 , piece_id=JG5CBLALQ5J6XH3JEB2BCADSMDPVL6SU5X2Y3VAULHN5BITT2LUA, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: write tcp 188.166.225.170:57494->145.79.227.41:4088: use of closed network connection; write tcp 188.166.225.170:57494->145.79.227.41:4088: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57494->145.79.227.41:4088: use of closed network connection Sep 6 09:39:08.914745004 (187h31m5.594940573s) [noise=true , address=145.79.227.31:4802 , piece_id=WK3XXXLJSFLKOKZCRWXMW7RP5WC5NHQJFTMOVPCDVGVEGNCWPFLQ, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1iMEuZv8uHpYjTqP9JVpznKPPdEyyy4xMTsgVUGMuCjZkV4cri, address:145.79.227.31:4802): protocol: write tcp 188.166.225.170:37872->145.79.227.31:4802: use of closed network connection; write tcp 188.166.225.170:37872->145.79.227.31:4802: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37872->145.79.227.31:4802: use of closed network connection Sep 6 09:39:08.914774080 (187h31m5.594969649s) [noise=true , address=145.79.227.33:4869 , piece_id=VHDMPTYXONABQOYVIBLTIZDYVMKLRZUCCAFAF5DUBONTYKUWJZHQ, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:18CQxjq65r6xVTmNRurSQPzKxj4BoR6cJ8Uq29sTrdh6uXm5sq, address:145.79.227.33:4869): protocol: read tcp 188.166.225.170:60510->145.79.227.33:4869: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:08.914808736 (187h31m5.595004305s) [noise=true , address=145.79.227.14:4846 , piece_id=ZFFFZLB6FUTDIAJSNYBPEJETGCRCT5A5LWHXOFT3W5SYBENFMA4Q, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR, address:145.79.227.14:4846): protocol: read tcp 188.166.225.170:58352->145.79.227.14:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:08.914814737 (187h31m5.595010297s) [noise=true , address=145.79.227.12:4787 , piece_id=EVNQABMGMOCG3A7FBKMNAZPDJMSS7FO76YRD7BE2QPXZONGU4TCQ, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:1HiqDGVv9cDPmxCNevHz7HYV6Sna6KqHhgeBkys6zcrKZMXSyh, address:145.79.227.12:4787): protocol: read tcp 188.166.225.170:51708->145.79.227.12:4787: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:08.914850997 (187h31m5.595046566s) [noise=true , address=45.91.116.7:4022 , piece_id=SQC6YVIP3PQH3R4LYTZODFK6QS5SHTGDLEXSE44Y3IDSPD362N2A, seg_pos={0 0}, upload=164995]: Done uploading piece. err: ecclient: upload failed (node:12AsdD55hrnDtX47RL9vvS2nEeKt81AxYf3sgf5YAcTGggC6Rbi, address:45.91.116.7:4022): protocol: read tcp 188.166.225.170:50474->45.91.116.7:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:08.914876966 (187h31m5.595072525s) [seg_pos={0 0}, upload=164995]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m2.368728835s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration: 1m0.221287716s FAIL (2025-09-06 09:39:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 13) ======LOGS====== oading piece. err: <nil> Sep 6 09:38:09.584001067 (187h30m6.264196636s) [noise=true , address=89.149.201.147:4011 , piece_id=2AVJFKI2O4SRMHKOFGMV3P2HAF2SDFHR7U42LYBP3H24H3AY2H3Q, seg_pos={0 0}, upload=164993]: Done uploading piece. err: <nil> Sep 6 09:38:09.621907653 (187h30m6.302103222s) [noise=true , address=89.149.201.147:4020 , piece_id=P3XWVAPZP3MQSYSB6WC45YMU3CE3FU6ZUJFJ5X3KHQLUUKPTUAZQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: <nil> Sep 6 09:38:10.015708636 (187h30m6.695904205s) [noise=true , address=89.149.201.147:4010 , piece_id=4E7HIR4CSCDLAMQH5KUFXXNRKWXZDJD3JRR72MDN72LMFEINUQCA, seg_pos={0 0}, upload=164993]: Done uploading piece. err: <nil> Sep 6 09:38:10.020895652 (187h30m6.701091231s) [noise=true , address=89.149.201.147:4006 , piece_id=QJNK5XXBS73TZ623TMGMUDU5G2NQBWYN5DMDSEDIAJ5PBXT2YG2A, seg_pos={0 0}, upload=164993]: Done uploading piece. err: <nil> Sep 6 09:38:10.060152241 (187h30m6.74034781s) [noise=true , address=89.149.201.147:4015 , piece_id=5ZR5IFXWOJZ3EUH3VW5KXLVBDA3B567BPSCAI7AQR2F2LDFZOXAQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: <nil> Sep 6 09:38:10.146609931 (187h30m6.8268055s) [noise=true , address=89.149.201.147:4022 , piece_id=7U2ZO6C55VMZSMVYT3RHWWFZNENK7QPSFA2ZZQ5ROSJLN3JIA5SA, seg_pos={0 0}, upload=164993]: Done uploading piece. err: <nil> Sep 6 09:39:07.437715261 (187h31m4.11791083s) [noise=true , address=185.167.204.205:4023 , piece_id=HL7WCJLMKNYPDEMZL2GSDNLKZLEHQGQDOY4P2BSCHUCAXAGF7EPQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:50356->185.167.204.205:4023: use of closed network connection; write tcp 188.166.225.170:50356->185.167.204.205:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50356->185.167.204.205:4023: use of closed network connection Sep 6 09:39:07.437769204 (187h31m4.117964773s) [noise=true , address=81.171.14.70:4028 , piece_id=X5LVQG4LXIW4SOYSECVQI4E75WWLG57BE4N25WMTNKB3B2VESJGQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:51426->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:51426->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51426->81.171.14.70:4028: use of closed network connection Sep 6 09:39:07.437836883 (187h31m4.118032452s) [noise=true , address=185.167.204.205:4014 , piece_id=4OWBNAWZYW2XGDKWWFZJZ3EA5TX5MBVHKHGROPOTKIN7SFASLLPA, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 188.166.225.170:34026->185.167.204.205:4014: use of closed network connection; write tcp 188.166.225.170:34026->185.167.204.205:4014: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34026->185.167.204.205:4014: use of closed network connection Sep 6 09:39:07.437963075 (187h31m4.118158644s) [noise=true , address=185.167.204.206:4051 , piece_id=644OALD3L5XFGAYPPSC5ZE5RU6NG54JRO4VF5EQJUEMIWZCROG3A, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:48574->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:48574->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48574->185.167.204.206:4051: use of closed network connection Sep 6 09:39:07.438065211 (187h31m4.11826078s) [noise=true , address=185.167.204.205:4002 , piece_id=5557CF6PYQU4NFIDJQBI4QSMMMZITI3UMGGRGLLRI3L76OAOJYWA, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: read tcp 188.166.225.170:59868->185.167.204.205:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:07.438074328 (187h31m4.118269887s) [noise=true , address=185.167.204.205:4035 , piece_id=ZJ2GRZJGECKS6O4U5NAEPITAKDH76YPDYGZYBIWEW66PZBZG32EQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: write tcp 188.166.225.170:53610->185.167.204.205:4035: use of closed network connection; write tcp 188.166.225.170:53610->185.167.204.205:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53610->185.167.204.205:4035: use of closed network connection Sep 6 09:39:07.438105938 (187h31m4.118301507s) [noise=true , address=185.167.204.206:4072 , piece_id=OMPDSFDL7MGFLM5UI6OYH6E3SN2COFTGRM2OJUSYD4L36UDGEB5Q, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: read tcp 188.166.225.170:40004->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:07.438137428 (187h31m4.118332997s) [noise=true , address=185.167.204.205:4017 , piece_id=ZGOR4JEUVCCWVBY3ZLE6ZDA5BBCNKGISYBLTDQA6UHJ2CWIYEICA, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 188.166.225.170:57646->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:07.438167907 (187h31m4.118363477s) [noise=true , address=81.171.14.70:4048 , piece_id=Y2LCA2HEXKYJHRXP4JD3UZUSCCCJOMYDXO3YVACUYX6CTLRQMA4Q, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: read tcp 188.166.225.170:38116->81.171.14.70:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:07.438190310 (187h31m4.118385879s) [noise=true , address=185.167.204.205:4036 , piece_id=H43E6LHHI2DTB24GXZL5FNV3YEKHGSVQZFAJG33N6CXOG5RSJXXA, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 188.166.225.170:44016->185.167.204.205:4036: use of closed network connection; write tcp 188.166.225.170:44016->185.167.204.205:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44016->185.167.204.205:4036: use of closed network connection Sep 6 09:39:07.438299599 (187h31m4.118495168s) [noise=true , address=81.171.14.70:4045 , piece_id=OLEBRNYTTQHUESRBKYNSLKOE72F3WTTWI3WCDH4VQNN2GA4LNYDQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 188.166.225.170:34622->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:07.438321320 (187h31m4.118516889s) [noise=true , address=81.171.14.70:4026 , piece_id=BGMDJY6R6YC46JZCFU7TEE3EF36QTOW32VDLDENTTM3PCU3TMMKA, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:41268->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:41268->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41268->81.171.14.70:4026: use of closed network connection Sep 6 09:39:07.438347460 (187h31m4.11854303s) [noise=true , address=185.167.204.206:4056 , piece_id=TAZHIDS32T3H6UN3NLYK64MHGKICNHE54EH2RVYXHOFTXQ6CIOQQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: read tcp 188.166.225.170:39802->185.167.204.206:4056: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:07.438354013 (187h31m4.118549582s) [noise=true , address=185.167.204.206:4071 , piece_id=FQFFM3NMFYNWXWW2VEAJ4UTBTCZCW4H2EXNOP2ZU266ON3YHEEFQ, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:46948->185.167.204.206:4071: use of closed network connection; context deadline exceeded Sep 6 09:39:07.438402255 (187h31m4.118597824s) [noise=true , address=185.167.204.206:4062 , piece_id=G67S5YUIH6XG34Y5WMBL2OWLS4USNZLRVS4WY7Z4SUY6APHO3L6Q, seg_pos={0 0}, upload=164993]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: read tcp 188.166.225.170:58654->185.167.204.206:4062: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 6 09:39:07.438419268 (187h31m4.118614837s) [seg_pos={0 0}, upload=164993]: Done waiting for segment. successful: 13 optimal: 26 errs: <nil> Sep 6 09:39:07.657334099 (187h31m4.337529678s) [upload=164993]: Done uploading segments... Sep 6 09:39:07.657362874 (187h31m4.337558443s) [upload=164993]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 13) Duration: 1m0.2213002s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)