Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 3.894742886s FAIL (2025-08-21 10:06:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.894996139s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [......X...............X.XX.....................X..X.....X...] duration: 1.827749536s FAIL (2025-08-21 10:05:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.827767489s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X........................X........X.....X...........] duration: 5.945241019s FAIL (2025-08-21 10:05:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.945267409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X........................X........X.....X..........] duration: 5.826644971s FAIL (2025-08-21 10:05:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.826673095s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 3.888425306s FAIL (2025-08-21 10:05:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.888453981s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.......X...............X.XX.....................X..X.....X..] duration: 2.018807502s FAIL (2025-08-21 10:04:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 2.018831727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X........................X........X.....X.........] duration: 5.692336664s FAIL (2025-08-21 10:04:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.692353596s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 3.865115487s FAIL (2025-08-21 10:04:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.865151515s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [........X...............X.XX.....................X..X.....X.] duration: 1.81068671s FAIL (2025-08-21 10:04:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.810713832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X........................X........X.....X........] duration: 5.492251774s FAIL (2025-08-21 10:04:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.492288055s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X........................X........X.....X.......] duration: 5.703082902s FAIL (2025-08-21 10:03:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.703103802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.........X...............X.XX.....................X..X.....X] duration: 1.571097376s FAIL (2025-08-21 10:03:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 21 10:03:32.711514666 (304h37m27.142594788s) [upload=316868]: Starting upload Aug 21 10:03:32.711553612 (304h37m27.142633743s) [upload=316868]: Done starting upload Aug 21 10:03:32.711614448 (304h37m27.142694609s) [upload=316868]: Uploading segments... Aug 21 10:03:32.711648523 (304h37m27.142728654s) [upload=316868]: Got next segment. Inline: true Aug 21 10:03:32.711653563 (304h37m27.142733684s) [upload=316868]: Waiting for error group managing segments... Aug 21 10:03:32.711696114 (304h37m27.142776245s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:03:32.711700202 (304h37m27.142780333s) [upload=316868]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:03:32.711702516 (304h37m27.142782647s) [upload=316868]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:03:32.978018798 (304h37m27.409098929s) [upload=316868]: Done uploading segments... Aug 21 10:03:32.978037905 (304h37m27.409118036s) [upload=316868]: Upload finished. err: <nil> Duration:* 1.571126199s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 3.95157141s FAIL (2025-08-21 10:03:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.951601658s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X........................X........X.....X......] duration: 5.705499341s FAIL (2025-08-21 10:03:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.705526041s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 3.866135118s FAIL (2025-08-21 10:03:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.866174764s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X...............X.XX.....................X..X.....] duration: 1.924599837s FAIL (2025-08-21 10:02:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.924636207s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X........................X........X.....X.....] duration: 5.668489954s FAIL (2025-08-21 10:02:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.668521375s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 4.042304458s FAIL (2025-08-21 10:02:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 4.042330759s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...........X...............X.XX.....................X..X....] duration: 1.976526432s FAIL (2025-08-21 10:02:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.97655185s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X........................X........X.....X....] duration: 5.570743661s FAIL (2025-08-21 10:02:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.570776824s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 3.920630817s FAIL (2025-08-21 10:02:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.920662507s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [............X...............X.XX.....................X..X...] duration: 1.807286574s FAIL (2025-08-21 10:01:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.807310239s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X........................X........X.....X...] duration: 5.735439494s FAIL (2025-08-21 10:01:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.73546845s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.............X...............X.XX.....................X..X..] duration: 2.033812624s FAIL (2025-08-21 10:01:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.033839696s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 4.180310754s FAIL (2025-08-21 10:00:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 4.18032986s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..............X...............X.XX.....................X..X.] duration: 1.819561149s FAIL (2025-08-21 10:00:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.819586416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X........................X........X.....X..] duration: 5.554291382s FAIL (2025-08-21 10:00:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.55432221s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 3.894971844s FAIL (2025-08-21 10:00:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.895001601s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...............X...............X.XX.....................X..X] duration: 883.964435ms FAIL (2025-08-21 10:00:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 10:00:07.634136717 (304h34m2.065216848s) [upload=316806]: Starting upload Aug 21 10:00:07.634192544 (304h34m2.065272675s) [upload=316806]: Done starting upload Aug 21 10:00:07.634243111 (304h34m2.065323242s) [upload=316806]: Uploading segments... Aug 21 10:00:07.634278989 (304h34m2.06535912s) [upload=316806]: Got next segment. Inline: true Aug 21 10:00:07.634282966 (304h34m2.065363097s) [upload=316806]: Waiting for error group managing segments... Aug 21 10:00:07.634317433 (304h34m2.065397564s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 10:00:07.634321501 (304h34m2.065401632s) [upload=316806]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 10:00:07.634324546 (304h34m2.065404677s) [upload=316806]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 10:00:07.864056889 (304h34m2.29513703s) [upload=316806]: Done uploading segments... Aug 21 10:00:07.864079242 (304h34m2.295159373s) [upload=316806]: Upload finished. err: metaclient: Too Many Requests Duration:* 884.017658ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 3.864170668s FAIL (2025-08-21 09:59:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.86419314s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X........................X........X.....X.] duration: 5.695746727s FAIL (2025-08-21 09:59:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 5.695774581s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [................X...............X.XX.....................X..] duration: 1.906609427s FAIL (2025-08-21 09:58:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 76475c40eac0c2ef0b73ab08a64426f3f0535981472b5d018e28c46fc58b1171 != before 399c08ca4c21249b9c2aeda428d674480bb409e0d6532c15a26497ea35e8fdfd ======LOGS====== Aug 21 09:57:55.463219671 (304h31m49.894299792s) [upload=316769]: Starting upload Aug 21 09:57:55.463266171 (304h31m49.894346302s) [upload=316769]: Done starting upload Aug 21 09:57:55.463316317 (304h31m49.894396438s) [upload=316769]: Uploading segments... Aug 21 09:57:55.463352616 (304h31m49.894432747s) [upload=316769]: Got next segment. Inline: true Aug 21 09:57:55.463356874 (304h31m49.894436995s) [upload=316769]: Waiting for error group managing segments... Aug 21 09:57:55.463390849 (304h31m49.89447097s) [upload=316769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:57:55.463395138 (304h31m49.894475269s) [upload=316769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 09:57:55.463397883 (304h31m49.894478014s) [upload=316769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:57:56.134679374 (304h31m50.565759505s) [upload=316769]: Done uploading segments... Aug 21 09:57:56.134700815 (304h31m50.565780946s) [upload=316769]: Upload finished. err: <nil> Duration:* 1.906633022s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X........................X........X.....X] duration: 3.832438059s FAIL (2025-08-21 09:58:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:58:35.885169053 (304h32m30.316249184s) [upload=316783]: Starting upload Aug 21 09:58:35.885212175 (304h32m30.316292296s) [upload=316783]: Done starting upload Aug 21 09:58:35.885294383 (304h32m30.316374514s) [upload=316783]: Uploading segments... Aug 21 09:58:35.885393673 (304h32m30.316473804s) [upload=316783]: Got next segment. Inline: false Aug 21 09:58:35.885429481 (304h32m30.316509602s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:58:35.885433970 (304h32m30.316514101s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:58:36.335195422 (304h32m30.766275553s) [seg_pos={0 0}, upload=316783]: Begin upload segment... Aug 21 09:58:36.335240368 (304h32m30.766320489s) [seg_pos={0 0}, upload=316783]: Done begin upload segment. Aug 21 09:58:36.335261218 (304h32m30.766341349s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335297047 (304h32m30.766377178s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335779499 (304h32m30.76685963s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.335789499 (304h32m30.76686963s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336066208 (304h32m30.767146339s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336071538 (304h32m30.767151659s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336418102 (304h32m30.767498233s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336481743 (304h32m30.767561864s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336761709 (304h32m30.76784184s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.336915734 (304h32m30.767995865s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337000767 (304h32m30.768080888s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337237569 (304h32m30.76831769s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337488530 (304h32m30.768568651s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.337743478 (304h32m30.768823609s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338033181 (304h32m30.769113312s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338312106 (304h32m30.769392227s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338552565 (304h32m30.769632696s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:36.338709586 (304h32m30.769789717s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Uploading piece... Aug 21 09:58:37.450110472 (304h32m31.881190603s) [upload=316783]: Next returned nil segment Aug 21 09:58:37.450136782 (304h32m31.881216913s) [upload=316783]: Waiting for error group managing segments... Aug 21 09:58:37.731946280 (304h32m32.163026401s) [noise=true , address=79.127.205.235:4657 , piece_id=2WTSZVQLLESPX4TZ2OFGU5524ZFI2CBIOHGRYBMLC5P5PECMVENQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:37.766414841 (304h32m32.197494972s) [noise=true , address=79.127.205.245:4244 , piece_id=UVI3IIAQUSB3FIDH4I6AOMGWIQECBUJAGPP2WYIVROJ7LCDG76VA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.220382481 (304h32m32.651462612s) [noise=true , address=45.91.116.8:4070 , piece_id=VE2J5EVMAJZGP4TPGJFSOYHVF47KA3OR2ZZ5A5SCIGPKCGRUSK7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.237833702 (304h32m32.668913833s) [noise=true , address=77.90.31.18:4825 , piece_id=37XR7PMLSG4IED6SINBUS3DMSPE7CEK5FAV4V47RWJUOYKR3O5XQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.243732429 (304h32m32.67481256s) [noise=true , address=77.90.31.16:4743 , piece_id=DE3O3VWUBLXFUIBJ5W2HUL3DHIDWYAWFPWCQ7GS5FBY4RIFFXESA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.245836654 (304h32m32.676916775s) [noise=true , address=79.127.219.51:4208 , piece_id=VJGSNFW7POK7SGLM4STQSWC24FMACJOO254UYAQDN3QHE5DJDTOQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.257314697 (304h32m32.688394828s) [noise=true , address=104.36.82.5:4863 , piece_id=LTNFZUWG5YOQV3TJJRWR4JPZD74WLZMCGQV36Y5N6YA4ZRSULMUQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.258470548 (304h32m32.689550679s) [noise=true , address=104.36.82.60:4352 , piece_id=Z22AG7IHUM7ATN6GBUOONUQZ32GWYUKPIRFCFPCHEIX4JFDDUULQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.281754800 (304h32m32.712834931s) [noise=true , address=77.90.31.21:4912 , piece_id=JGALGRIRU5KR2GSSOAZBXQBSBDUDSV4DYI2AX7OMYUGUK4ZU75BA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.290050623 (304h32m32.721130754s) [noise=true , address=45.91.116.13:4158 , piece_id=W2WP2NCBR4LHS3BLAR4U36KBLM4XCXOKSYNMASHBZYY7W27MZO7A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.299882014 (304h32m32.730962135s) [noise=true , address=77.90.31.10:4552 , piece_id=TVGSSNSVOP73HAX4XTCFXYF7HJUCX2S54CEO2AXRKEEE5RBC7K7Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.303124137 (304h32m32.734204268s) [noise=true , address=45.91.116.11:4134 , piece_id=6EQLP3T2KVQKUXBW5UFT2LTOLUOS7YD3B27WH3AGQ2DAZADQFR6A, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.311587421 (304h32m32.742667552s) [noise=true , address=79.127.219.48:4108 , piece_id=RXRKUVIW5KF4IYKQS6O6LN2R5NHVFB6MLZIRWCL2JIH3TIIRS57Q, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324381751 (304h32m32.755461882s) [noise=true , address=79.127.219.47:4054 , piece_id=UZGHM2Q3CA5JV6VP64RU4NRKYAJEXEKP45RN6ZEKGTMVITSALLXQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: <nil> Aug 21 09:58:38.324410265 (304h32m32.755490416s) [seg_pos={0 0}, upload=316783]: Segment reached optimal threshold of 14 pieces. Aug 21 09:58:38.324581673 (304h32m32.755661804s) [noise=true , address=104.36.82.10:4098 , piece_id=6TSYA5NKYOSDEJR6ODSRDFHHLRECBEASHRKINGHGO6TFMC4YEXNA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122fmWY53WxM6KHuXzdKsCbWWCtCFDUGowvSqALWUdFnbYVJoSY): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324597023 (304h32m32.755677144s) [noise=true , address=77.90.31.15:4730 , piece_id=IA73AVLUVN6AZXW5OPIA6TLTGO53RVGRADX4AXB466NIPQ6AOQJQ, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324662037 (304h32m32.755742158s) [noise=true , address=104.36.82.23:4472 , piece_id=5NVYE6ENBDZHXAFFFWQGUKVG4W3YOZMON6IFIJZDXACBVIWCGEZA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324695933 (304h32m32.755776064s) [noise=true , address=77.90.31.11:4567 , piece_id=QRI32W3VYE7R5BG7W6TRPWH77XVXG7PYG5ZM2OWIKEDRMEDJPSWA, seg_pos={0 0}, upload=316783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HJVmEuxjrwWCcdwxWYFC5fTULds1kiRH82DiRWipWhRT1Qwdk): protocol: expected piece hash; context canceled; EOF Aug 21 09:58:38.324713125 (304h32m32.755793246s) [seg_pos={0 0}, upload=316783]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:58:38.324779292 (304h32m32.755859413s) [upload=316783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:58:38.324783420 (304h32m32.755863551s) [upload=316783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:58:38.617108146 (304h32m33.048188287s) [upload=316783]: Done uploading segments... Aug 21 09:58:38.617122814 (304h32m33.048202985s) [upload=316783]: Upload finished. err: <nil> Duration: 3.832461375s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 3.863788564s FAIL (2025-08-21 09:58:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.863813682s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.................X...............X.XX.....................X.] duration: 1.813641935s FAIL (2025-08-21 09:58:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 76475c40eac0c2ef0b73ab08a64426f3f0535981472b5d018e28c46fc58b1171 != before 399c08ca4c21249b9c2aeda428d674480bb409e0d6532c15a26497ea35e8fdfd ======LOGS====== Aug 21 09:57:55.463219671 (304h31m49.894299792s) [upload=316769]: Starting upload Aug 21 09:57:55.463266171 (304h31m49.894346302s) [upload=316769]: Done starting upload Aug 21 09:57:55.463316317 (304h31m49.894396438s) [upload=316769]: Uploading segments... Aug 21 09:57:55.463352616 (304h31m49.894432747s) [upload=316769]: Got next segment. Inline: true Aug 21 09:57:55.463356874 (304h31m49.894436995s) [upload=316769]: Waiting for error group managing segments... Aug 21 09:57:55.463390849 (304h31m49.89447097s) [upload=316769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:57:55.463395138 (304h31m49.894475269s) [upload=316769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 09:57:55.463397883 (304h31m49.894478014s) [upload=316769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:57:56.134679374 (304h31m50.565759505s) [upload=316769]: Done uploading segments... Aug 21 09:57:56.134700815 (304h31m50.565780946s) [upload=316769]: Upload finished. err: <nil> Duration:* 1.813669539s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X........................X........X.....] duration: 5.719797732s FAIL (2025-08-21 09:58:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:55:10.905526012 (304h29m5.336606173s) [upload=316724]: Starting upload Aug 21 09:55:10.905603360 (304h29m5.336683491s) [upload=316724]: Done starting upload Aug 21 09:55:10.905747135 (304h29m5.336827276s) [upload=316724]: Uploading segments... Aug 21 09:55:10.906032441 (304h29m5.337112572s) [upload=316724]: Got next segment. Inline: false Aug 21 09:55:10.906069953 (304h29m5.337150084s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:55:10.906075574 (304h29m5.337155705s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:55:11.396359190 (304h29m5.827439331s) [seg_pos={0 0}, upload=316724]: Begin upload segment... Aug 21 09:55:11.396422221 (304h29m5.827502352s) [seg_pos={0 0}, upload=316724]: Done begin upload segment. Aug 21 09:55:11.396454473 (304h29m5.827534694s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.396467758 (304h29m5.827547889s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397120848 (304h29m5.828201029s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397177546 (304h29m5.828257677s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397507197 (304h29m5.828587328s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397656793 (304h29m5.828736924s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397828642 (304h29m5.828908773s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398101184 (304h29m5.829181315s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398365940 (304h29m5.829446071s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399200307 (304h29m5.830280428s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399499539 (304h29m5.83057967s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399758505 (304h29m5.830838636s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.400016097 (304h29m5.831096218s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.401181387 (304h29m5.832261518s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402393256 (304h29m5.833473387s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402688169 (304h29m5.833768381s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402935604 (304h29m5.834015735s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.403194429 (304h29m5.83427455s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:12.518004468 (304h29m6.949084599s) [upload=316724]: Next returned nil segment Aug 21 09:55:12.518033915 (304h29m6.949114046s) [upload=316724]: Waiting for error group managing segments... Aug 21 09:55:12.799966888 (304h29m7.231047019s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:12.874049606 (304h29m7.305129737s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.260061371 (304h29m7.691141502s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.307705712 (304h29m7.738785843s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.310209063 (304h29m7.741289194s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.339735388 (304h29m7.770815519s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.348685993 (304h29m7.779766124s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.352397725 (304h29m7.783477846s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.362940056 (304h29m7.794020177s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.370619871 (304h29m7.801700002s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.380661444 (304h29m7.811741575s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.381304375 (304h29m7.812384506s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.396674343 (304h29m7.827754474s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417149319 (304h29m7.84822945s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417178886 (304h29m7.848259007s) [seg_pos={0 0}, upload=316724]: Segment reached optimal threshold of 14 pieces. Aug 21 09:55:13.417299075 (304h29m7.848379206s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16HwqYhJnhseWEhzzv4QreZ953rB5cKxqFX8swEqaqiRXCRsAE): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417364992 (304h29m7.848445123s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417432260 (304h29m7.848512381s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417454253 (304h29m7.848534384s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417468720 (304h29m7.848548841s) [seg_pos={0 0}, upload=316724]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:55:13.417567028 (304h29m7.848647159s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:55:13.417571928 (304h29m7.848652059s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:55:13.719205626 (304h29m8.150285747s) [upload=316724]: Done uploading segments... Aug 21 09:55:13.719225645 (304h29m8.150305776s) [upload=316724]: Upload finished. err: <nil> Duration: 5.719822099s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..................X...............X.XX.....................X] duration: 2.558494246s FAIL (2025-08-21 09:57:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 76475c40eac0c2ef0b73ab08a64426f3f0535981472b5d018e28c46fc58b1171 != before 399c08ca4c21249b9c2aeda428d674480bb409e0d6532c15a26497ea35e8fdfd ======LOGS====== Aug 21 09:57:55.463219671 (304h31m49.894299792s) [upload=316769]: Starting upload Aug 21 09:57:55.463266171 (304h31m49.894346302s) [upload=316769]: Done starting upload Aug 21 09:57:55.463316317 (304h31m49.894396438s) [upload=316769]: Uploading segments... Aug 21 09:57:55.463352616 (304h31m49.894432747s) [upload=316769]: Got next segment. Inline: true Aug 21 09:57:55.463356874 (304h31m49.894436995s) [upload=316769]: Waiting for error group managing segments... Aug 21 09:57:55.463390849 (304h31m49.89447097s) [upload=316769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:57:55.463395138 (304h31m49.894475269s) [upload=316769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 09:57:55.463397883 (304h31m49.894478014s) [upload=316769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:57:56.134679374 (304h31m50.565759505s) [upload=316769]: Done uploading segments... Aug 21 09:57:56.134700815 (304h31m50.565780946s) [upload=316769]: Upload finished. err: <nil> Duration:* 2.558521237s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 3.883784986s FAIL (2025-08-21 09:57:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.883811006s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...................X...............X.XX.....................] duration: 1.967227873s FAIL (2025-08-21 09:57:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 09:40:40.014562937 (304h14m34.445643069s) [upload=316472]: Starting upload Aug 21 09:40:40.014609146 (304h14m34.445689267s) [upload=316472]: Done starting upload Aug 21 09:40:40.014660875 (304h14m34.445740996s) [upload=316472]: Uploading segments... Aug 21 09:40:40.014693287 (304h14m34.445773418s) [upload=316472]: Got next segment. Inline: true Aug 21 09:40:40.014696714 (304h14m34.445776845s) [upload=316472]: Waiting for error group managing segments... Aug 21 09:40:40.014730849 (304h14m34.44581097s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:40:40.014734796 (304h14m34.445814927s) [upload=316472]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 09:40:40.014737332 (304h14m34.445817463s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:40:40.230140739 (304h14m34.66122087s) [upload=316472]: Done uploading segments... Aug 21 09:40:40.230158053 (304h14m34.661238184s) [upload=316472]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.967253834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X........................X........X....] duration: 5.661127037s FAIL (2025-08-21 09:57:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:55:10.905526012 (304h29m5.336606173s) [upload=316724]: Starting upload Aug 21 09:55:10.905603360 (304h29m5.336683491s) [upload=316724]: Done starting upload Aug 21 09:55:10.905747135 (304h29m5.336827276s) [upload=316724]: Uploading segments... Aug 21 09:55:10.906032441 (304h29m5.337112572s) [upload=316724]: Got next segment. Inline: false Aug 21 09:55:10.906069953 (304h29m5.337150084s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:55:10.906075574 (304h29m5.337155705s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:55:11.396359190 (304h29m5.827439331s) [seg_pos={0 0}, upload=316724]: Begin upload segment... Aug 21 09:55:11.396422221 (304h29m5.827502352s) [seg_pos={0 0}, upload=316724]: Done begin upload segment. Aug 21 09:55:11.396454473 (304h29m5.827534694s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.396467758 (304h29m5.827547889s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397120848 (304h29m5.828201029s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397177546 (304h29m5.828257677s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397507197 (304h29m5.828587328s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397656793 (304h29m5.828736924s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397828642 (304h29m5.828908773s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398101184 (304h29m5.829181315s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398365940 (304h29m5.829446071s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399200307 (304h29m5.830280428s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399499539 (304h29m5.83057967s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399758505 (304h29m5.830838636s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.400016097 (304h29m5.831096218s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.401181387 (304h29m5.832261518s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402393256 (304h29m5.833473387s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402688169 (304h29m5.833768381s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402935604 (304h29m5.834015735s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.403194429 (304h29m5.83427455s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:12.518004468 (304h29m6.949084599s) [upload=316724]: Next returned nil segment Aug 21 09:55:12.518033915 (304h29m6.949114046s) [upload=316724]: Waiting for error group managing segments... Aug 21 09:55:12.799966888 (304h29m7.231047019s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:12.874049606 (304h29m7.305129737s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.260061371 (304h29m7.691141502s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.307705712 (304h29m7.738785843s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.310209063 (304h29m7.741289194s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.339735388 (304h29m7.770815519s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.348685993 (304h29m7.779766124s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.352397725 (304h29m7.783477846s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.362940056 (304h29m7.794020177s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.370619871 (304h29m7.801700002s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.380661444 (304h29m7.811741575s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.381304375 (304h29m7.812384506s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.396674343 (304h29m7.827754474s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417149319 (304h29m7.84822945s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417178886 (304h29m7.848259007s) [seg_pos={0 0}, upload=316724]: Segment reached optimal threshold of 14 pieces. Aug 21 09:55:13.417299075 (304h29m7.848379206s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16HwqYhJnhseWEhzzv4QreZ953rB5cKxqFX8swEqaqiRXCRsAE): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417364992 (304h29m7.848445123s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417432260 (304h29m7.848512381s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417454253 (304h29m7.848534384s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417468720 (304h29m7.848548841s) [seg_pos={0 0}, upload=316724]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:55:13.417567028 (304h29m7.848647159s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:55:13.417571928 (304h29m7.848652059s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:55:13.719205626 (304h29m8.150285747s) [upload=316724]: Done uploading segments... Aug 21 09:55:13.719225645 (304h29m8.150305776s) [upload=316724]: Upload finished. err: <nil> Duration: 5.661156683s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X...................X...............X.XX....................] duration: 1.840299421s FAIL (2025-08-21 09:56:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 09:40:40.014562937 (304h14m34.445643069s) [upload=316472]: Starting upload Aug 21 09:40:40.014609146 (304h14m34.445689267s) [upload=316472]: Done starting upload Aug 21 09:40:40.014660875 (304h14m34.445740996s) [upload=316472]: Uploading segments... Aug 21 09:40:40.014693287 (304h14m34.445773418s) [upload=316472]: Got next segment. Inline: true Aug 21 09:40:40.014696714 (304h14m34.445776845s) [upload=316472]: Waiting for error group managing segments... Aug 21 09:40:40.014730849 (304h14m34.44581097s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:40:40.014734796 (304h14m34.445814927s) [upload=316472]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 09:40:40.014737332 (304h14m34.445817463s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:40:40.230140739 (304h14m34.66122087s) [upload=316472]: Done uploading segments... Aug 21 09:40:40.230158053 (304h14m34.661238184s) [upload=316472]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.840327884s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 3.86007693s FAIL (2025-08-21 09:56:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.860103713s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X........................X........X...] duration: 5.759703851s FAIL (2025-08-21 09:56:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:55:10.905526012 (304h29m5.336606173s) [upload=316724]: Starting upload Aug 21 09:55:10.905603360 (304h29m5.336683491s) [upload=316724]: Done starting upload Aug 21 09:55:10.905747135 (304h29m5.336827276s) [upload=316724]: Uploading segments... Aug 21 09:55:10.906032441 (304h29m5.337112572s) [upload=316724]: Got next segment. Inline: false Aug 21 09:55:10.906069953 (304h29m5.337150084s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:55:10.906075574 (304h29m5.337155705s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:55:11.396359190 (304h29m5.827439331s) [seg_pos={0 0}, upload=316724]: Begin upload segment... Aug 21 09:55:11.396422221 (304h29m5.827502352s) [seg_pos={0 0}, upload=316724]: Done begin upload segment. Aug 21 09:55:11.396454473 (304h29m5.827534694s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.396467758 (304h29m5.827547889s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397120848 (304h29m5.828201029s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397177546 (304h29m5.828257677s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397507197 (304h29m5.828587328s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397656793 (304h29m5.828736924s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397828642 (304h29m5.828908773s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398101184 (304h29m5.829181315s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398365940 (304h29m5.829446071s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399200307 (304h29m5.830280428s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399499539 (304h29m5.83057967s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399758505 (304h29m5.830838636s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.400016097 (304h29m5.831096218s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.401181387 (304h29m5.832261518s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402393256 (304h29m5.833473387s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402688169 (304h29m5.833768381s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402935604 (304h29m5.834015735s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.403194429 (304h29m5.83427455s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:12.518004468 (304h29m6.949084599s) [upload=316724]: Next returned nil segment Aug 21 09:55:12.518033915 (304h29m6.949114046s) [upload=316724]: Waiting for error group managing segments... Aug 21 09:55:12.799966888 (304h29m7.231047019s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:12.874049606 (304h29m7.305129737s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.260061371 (304h29m7.691141502s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.307705712 (304h29m7.738785843s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.310209063 (304h29m7.741289194s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.339735388 (304h29m7.770815519s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.348685993 (304h29m7.779766124s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.352397725 (304h29m7.783477846s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.362940056 (304h29m7.794020177s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.370619871 (304h29m7.801700002s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.380661444 (304h29m7.811741575s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.381304375 (304h29m7.812384506s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.396674343 (304h29m7.827754474s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417149319 (304h29m7.84822945s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417178886 (304h29m7.848259007s) [seg_pos={0 0}, upload=316724]: Segment reached optimal threshold of 14 pieces. Aug 21 09:55:13.417299075 (304h29m7.848379206s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16HwqYhJnhseWEhzzv4QreZ953rB5cKxqFX8swEqaqiRXCRsAE): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417364992 (304h29m7.848445123s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417432260 (304h29m7.848512381s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417454253 (304h29m7.848534384s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417468720 (304h29m7.848548841s) [seg_pos={0 0}, upload=316724]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:55:13.417567028 (304h29m7.848647159s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:55:13.417571928 (304h29m7.848652059s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:55:13.719205626 (304h29m8.150285747s) [upload=316724]: Done uploading segments... Aug 21 09:55:13.719225645 (304h29m8.150305776s) [upload=316724]: Upload finished. err: <nil> Duration: 5.759730773s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 3.90868488s FAIL (2025-08-21 09:56:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.908704337s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X........................X........X..] duration: 5.757793263s FAIL (2025-08-21 09:56:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:55:10.905526012 (304h29m5.336606173s) [upload=316724]: Starting upload Aug 21 09:55:10.905603360 (304h29m5.336683491s) [upload=316724]: Done starting upload Aug 21 09:55:10.905747135 (304h29m5.336827276s) [upload=316724]: Uploading segments... Aug 21 09:55:10.906032441 (304h29m5.337112572s) [upload=316724]: Got next segment. Inline: false Aug 21 09:55:10.906069953 (304h29m5.337150084s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:55:10.906075574 (304h29m5.337155705s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:55:11.396359190 (304h29m5.827439331s) [seg_pos={0 0}, upload=316724]: Begin upload segment... Aug 21 09:55:11.396422221 (304h29m5.827502352s) [seg_pos={0 0}, upload=316724]: Done begin upload segment. Aug 21 09:55:11.396454473 (304h29m5.827534694s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.396467758 (304h29m5.827547889s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397120848 (304h29m5.828201029s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397177546 (304h29m5.828257677s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397507197 (304h29m5.828587328s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397656793 (304h29m5.828736924s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397828642 (304h29m5.828908773s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398101184 (304h29m5.829181315s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398365940 (304h29m5.829446071s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399200307 (304h29m5.830280428s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399499539 (304h29m5.83057967s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399758505 (304h29m5.830838636s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.400016097 (304h29m5.831096218s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.401181387 (304h29m5.832261518s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402393256 (304h29m5.833473387s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402688169 (304h29m5.833768381s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402935604 (304h29m5.834015735s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.403194429 (304h29m5.83427455s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:12.518004468 (304h29m6.949084599s) [upload=316724]: Next returned nil segment Aug 21 09:55:12.518033915 (304h29m6.949114046s) [upload=316724]: Waiting for error group managing segments... Aug 21 09:55:12.799966888 (304h29m7.231047019s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:12.874049606 (304h29m7.305129737s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.260061371 (304h29m7.691141502s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.307705712 (304h29m7.738785843s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.310209063 (304h29m7.741289194s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.339735388 (304h29m7.770815519s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.348685993 (304h29m7.779766124s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.352397725 (304h29m7.783477846s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.362940056 (304h29m7.794020177s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.370619871 (304h29m7.801700002s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.380661444 (304h29m7.811741575s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.381304375 (304h29m7.812384506s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.396674343 (304h29m7.827754474s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417149319 (304h29m7.84822945s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417178886 (304h29m7.848259007s) [seg_pos={0 0}, upload=316724]: Segment reached optimal threshold of 14 pieces. Aug 21 09:55:13.417299075 (304h29m7.848379206s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16HwqYhJnhseWEhzzv4QreZ953rB5cKxqFX8swEqaqiRXCRsAE): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417364992 (304h29m7.848445123s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417432260 (304h29m7.848512381s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417454253 (304h29m7.848534384s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417468720 (304h29m7.848548841s) [seg_pos={0 0}, upload=316724]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:55:13.417567028 (304h29m7.848647159s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:55:13.417571928 (304h29m7.848652059s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:55:13.719205626 (304h29m8.150285747s) [upload=316724]: Done uploading segments... Aug 21 09:55:13.719225645 (304h29m8.150305776s) [upload=316724]: Upload finished. err: <nil> Duration: 5.757816456s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X...................X...............X.XX...................] duration: 1.818600501s FAIL (2025-08-21 09:56:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 09:40:40.014562937 (304h14m34.445643069s) [upload=316472]: Starting upload Aug 21 09:40:40.014609146 (304h14m34.445689267s) [upload=316472]: Done starting upload Aug 21 09:40:40.014660875 (304h14m34.445740996s) [upload=316472]: Uploading segments... Aug 21 09:40:40.014693287 (304h14m34.445773418s) [upload=316472]: Got next segment. Inline: true Aug 21 09:40:40.014696714 (304h14m34.445776845s) [upload=316472]: Waiting for error group managing segments... Aug 21 09:40:40.014730849 (304h14m34.44581097s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:40:40.014734796 (304h14m34.445814927s) [upload=316472]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 09:40:40.014737332 (304h14m34.445817463s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:40:40.230140739 (304h14m34.66122087s) [upload=316472]: Done uploading segments... Aug 21 09:40:40.230158053 (304h14m34.661238184s) [upload=316472]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.818624817s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X........................X........X.] duration: 5.626756381s FAIL (2025-08-21 09:55:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:55:10.905526012 (304h29m5.336606173s) [upload=316724]: Starting upload Aug 21 09:55:10.905603360 (304h29m5.336683491s) [upload=316724]: Done starting upload Aug 21 09:55:10.905747135 (304h29m5.336827276s) [upload=316724]: Uploading segments... Aug 21 09:55:10.906032441 (304h29m5.337112572s) [upload=316724]: Got next segment. Inline: false Aug 21 09:55:10.906069953 (304h29m5.337150084s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:55:10.906075574 (304h29m5.337155705s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:55:11.396359190 (304h29m5.827439331s) [seg_pos={0 0}, upload=316724]: Begin upload segment... Aug 21 09:55:11.396422221 (304h29m5.827502352s) [seg_pos={0 0}, upload=316724]: Done begin upload segment. Aug 21 09:55:11.396454473 (304h29m5.827534694s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.396467758 (304h29m5.827547889s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397120848 (304h29m5.828201029s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397177546 (304h29m5.828257677s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397507197 (304h29m5.828587328s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397656793 (304h29m5.828736924s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397828642 (304h29m5.828908773s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398101184 (304h29m5.829181315s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398365940 (304h29m5.829446071s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399200307 (304h29m5.830280428s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399499539 (304h29m5.83057967s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399758505 (304h29m5.830838636s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.400016097 (304h29m5.831096218s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.401181387 (304h29m5.832261518s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402393256 (304h29m5.833473387s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402688169 (304h29m5.833768381s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402935604 (304h29m5.834015735s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.403194429 (304h29m5.83427455s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:12.518004468 (304h29m6.949084599s) [upload=316724]: Next returned nil segment Aug 21 09:55:12.518033915 (304h29m6.949114046s) [upload=316724]: Waiting for error group managing segments... Aug 21 09:55:12.799966888 (304h29m7.231047019s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:12.874049606 (304h29m7.305129737s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.260061371 (304h29m7.691141502s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.307705712 (304h29m7.738785843s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.310209063 (304h29m7.741289194s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.339735388 (304h29m7.770815519s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.348685993 (304h29m7.779766124s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.352397725 (304h29m7.783477846s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.362940056 (304h29m7.794020177s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.370619871 (304h29m7.801700002s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.380661444 (304h29m7.811741575s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.381304375 (304h29m7.812384506s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.396674343 (304h29m7.827754474s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417149319 (304h29m7.84822945s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417178886 (304h29m7.848259007s) [seg_pos={0 0}, upload=316724]: Segment reached optimal threshold of 14 pieces. Aug 21 09:55:13.417299075 (304h29m7.848379206s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16HwqYhJnhseWEhzzv4QreZ953rB5cKxqFX8swEqaqiRXCRsAE): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417364992 (304h29m7.848445123s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417432260 (304h29m7.848512381s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417454253 (304h29m7.848534384s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417468720 (304h29m7.848548841s) [seg_pos={0 0}, upload=316724]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:55:13.417567028 (304h29m7.848647159s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:55:13.417571928 (304h29m7.848652059s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:55:13.719205626 (304h29m8.150285747s) [upload=316724]: Done uploading segments... Aug 21 09:55:13.719225645 (304h29m8.150305776s) [upload=316724]: Upload finished. err: <nil> Duration: 5.626797369s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X...................X...............X.XX..................] duration: 2.025663974s FAIL (2025-08-21 09:55:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 09:40:40.014562937 (304h14m34.445643069s) [upload=316472]: Starting upload Aug 21 09:40:40.014609146 (304h14m34.445689267s) [upload=316472]: Done starting upload Aug 21 09:40:40.014660875 (304h14m34.445740996s) [upload=316472]: Uploading segments... Aug 21 09:40:40.014693287 (304h14m34.445773418s) [upload=316472]: Got next segment. Inline: true Aug 21 09:40:40.014696714 (304h14m34.445776845s) [upload=316472]: Waiting for error group managing segments... Aug 21 09:40:40.014730849 (304h14m34.44581097s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:40:40.014734796 (304h14m34.445814927s) [upload=316472]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 09:40:40.014737332 (304h14m34.445817463s) [upload=316472]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:40:40.230140739 (304h14m34.66122087s) [upload=316472]: Done uploading segments... Aug 21 09:40:40.230158053 (304h14m34.661238184s) [upload=316472]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.025690294s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X........................X........X] duration: 3.894205024s FAIL (2025-08-21 09:55:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 21 09:55:10.905526012 (304h29m5.336606173s) [upload=316724]: Starting upload Aug 21 09:55:10.905603360 (304h29m5.336683491s) [upload=316724]: Done starting upload Aug 21 09:55:10.905747135 (304h29m5.336827276s) [upload=316724]: Uploading segments... Aug 21 09:55:10.906032441 (304h29m5.337112572s) [upload=316724]: Got next segment. Inline: false Aug 21 09:55:10.906069953 (304h29m5.337150084s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 09:55:10.906075574 (304h29m5.337155705s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 09:55:11.396359190 (304h29m5.827439331s) [seg_pos={0 0}, upload=316724]: Begin upload segment... Aug 21 09:55:11.396422221 (304h29m5.827502352s) [seg_pos={0 0}, upload=316724]: Done begin upload segment. Aug 21 09:55:11.396454473 (304h29m5.827534694s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.396467758 (304h29m5.827547889s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397120848 (304h29m5.828201029s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397177546 (304h29m5.828257677s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397507197 (304h29m5.828587328s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397656793 (304h29m5.828736924s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.397828642 (304h29m5.828908773s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398101184 (304h29m5.829181315s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.398365940 (304h29m5.829446071s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399200307 (304h29m5.830280428s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399499539 (304h29m5.83057967s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.399758505 (304h29m5.830838636s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.400016097 (304h29m5.831096218s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.401181387 (304h29m5.832261518s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402393256 (304h29m5.833473387s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402688169 (304h29m5.833768381s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.402935604 (304h29m5.834015735s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:11.403194429 (304h29m5.83427455s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Uploading piece... Aug 21 09:55:12.518004468 (304h29m6.949084599s) [upload=316724]: Next returned nil segment Aug 21 09:55:12.518033915 (304h29m6.949114046s) [upload=316724]: Waiting for error group managing segments... Aug 21 09:55:12.799966888 (304h29m7.231047019s) [noise=true , address=79.127.205.235:4657 , piece_id=XWPOKGRYDDYWTJ5FXH75JBZRRSVEEVOVXAQV34XESQMYCDOHECIQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:12.874049606 (304h29m7.305129737s) [noise=true , address=79.127.205.245:4248 , piece_id=A6ZHPPD3YX6RNIAMQEUB2HH6GSR2VXISY6UIDXCDR72J5N5WBFZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.260061371 (304h29m7.691141502s) [noise=true , address=79.127.220.98:4428 , piece_id=CLWU32XNVPGOVMXREYNKMUEJ2KF3YGYJVRYL7IKXSKR3NXRV3LPQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.307705712 (304h29m7.738785843s) [noise=true , address=104.36.82.40:4957 , piece_id=ZHKVUXTFQAMDPCXNBVZ7KBQRWWRP5YSJQQ3BVYUQ6MM475TITHOQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.310209063 (304h29m7.741289194s) [noise=true , address=45.91.116.6:4004 , piece_id=DOVFUIT3CPSZJJV7ANSTUUUZYLEZLPMQZYB2UBPNRSSTUC5JSFDA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.339735388 (304h29m7.770815519s) [noise=true , address=45.91.116.8:4070 , piece_id=VFSRJRGQ5ATFJ3KFTD4X2KHOCNLUHNK7B562YJMST3A3I7LHZIAQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.348685993 (304h29m7.779766124s) [noise=true , address=45.91.116.14:4203 , piece_id=JP4OC6Z37NU7XNI2MKBUUEZCC35P6XOMLMXNK4TBIR2HXVHAB2JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.352397725 (304h29m7.783477846s) [noise=true , address=77.90.31.10:4526 , piece_id=D4K7MJCASB6KAVLAZZELCD5XXWW5LT5R3RPGXZKO6TMXOQTP732A, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.362940056 (304h29m7.794020177s) [noise=true , address=104.36.82.5:4858 , piece_id=NHGI5VEBUMO5OUNT7OA6UB4UMNM2NBU6JAZW4QTRLPXBEVWVMZUA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.370619871 (304h29m7.801700002s) [noise=true , address=77.90.31.21:4893 , piece_id=IUGWXSY4XU6TX2PQ2PYB6YF6BZAW4Z2FYAKZQCO3G7AQ454W3SLA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.380661444 (304h29m7.811741575s) [noise=true , address=77.90.31.18:4809 , piece_id=VP6Q3GU5RNISTDDBWFI3RBJLOAOBVCSLPQ6QEMLUIQE37XY4K6WA, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.381304375 (304h29m7.812384506s) [noise=true , address=77.90.31.16:4743 , piece_id=WFWOKBWXZQDICHA4US7S54YG4OVKMVJZWWOYKGQIMEMRCDGAYRJQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.396674343 (304h29m7.827754474s) [noise=true , address=45.91.116.13:4178 , piece_id=S3RQ5CX6SAYKVBNZS2CRQSRPIH6WCQBLHY5LMZTU72WLDZ3GUOGQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417149319 (304h29m7.84822945s) [noise=true , address=104.36.82.60:4354 , piece_id=OJUHJCWITZZSRQWXJ6EFV3WLSOXLV4HRA62NXMFUQ2KQWCXYLK4Q, seg_pos={0 0}, upload=316724]: Done uploading piece. err: <nil> Aug 21 09:55:13.417178886 (304h29m7.848259007s) [seg_pos={0 0}, upload=316724]: Segment reached optimal threshold of 14 pieces. Aug 21 09:55:13.417299075 (304h29m7.848379206s) [noise=true , address=77.90.31.19:4854 , piece_id=4NCYSOX6SZWKXWRAXERGPI3OW5LBLP5JBSCIBLXACHQ74HYEQEDQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16HwqYhJnhseWEhzzv4QreZ953rB5cKxqFX8swEqaqiRXCRsAE): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417364992 (304h29m7.848445123s) [noise=true , address=79.127.201.215:4351 , piece_id=BVC2VSMRRSUIEYJCCZM3PUJ3KZMYXUEU2VYPEJZ7LBVHHGG2X7JQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417432260 (304h29m7.848512381s) [noise=true , address=77.90.31.13:4646 , piece_id=GR3RNATJCSMKY2P2XIQIJNJGEQNOL7M254WCC3X22VU735YQLUZQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417454253 (304h29m7.848534384s) [noise=true , address=104.36.82.44:4899 , piece_id=Z4MVOFKWVASQGQYYIURQ6FKMWS4PSRKFNUXUTSNEI5GIHBLMUEXQ, seg_pos={0 0}, upload=316724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF Aug 21 09:55:13.417468720 (304h29m7.848548841s) [seg_pos={0 0}, upload=316724]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 09:55:13.417567028 (304h29m7.848647159s) [upload=316724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 09:55:13.417571928 (304h29m7.848652059s) [upload=316724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 09:55:13.719205626 (304h29m8.150285747s) [upload=316724]: Done uploading segments... Aug 21 09:55:13.719225645 (304h29m8.150305776s) [upload=316724]: Upload finished. err: <nil> Duration: 3.894235833s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 3.976130378s FAIL (2025-08-21 09:55:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Uploading piece... Aug 21 09:25:01.622689552 (303h58m56.053769693s) [upload=316197]: Next returned nil segment Aug 21 09:25:01.622711935 (303h58m56.053792066s) [upload=316197]: Waiting for error group managing segments... Aug 21 09:25:02.006851367 (303h58m56.437931508s) [noise=true , address=81.171.14.70:4048 , piece_id=6WA7PH7Z3OMPLVS6YT2V5Y65RCAOUO2FZS2NFBVSPCILGGHEGG7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.009968412 (303h58m56.441048553s) [noise=true , address=81.171.14.70:4041 , piece_id=NI6YRNGFIQYXUFI7IO5IIYE73ROQIDYXXZVX2NZEXZP5HP5TWFYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.011808102 (303h58m56.442888243s) [noise=true , address=81.171.14.70:4042 , piece_id=TFDZVXYNFMYRNLHT5UH2TRODZOELQSU2S5PF4BCMVIUEEYJEYJVQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.013448941 (303h58m56.444529092s) [noise=true , address=81.171.14.70:4032 , piece_id=ZSBGQZHT64XDRRLCFGZ3PTI4AV6RYZNMBJSSWWTCQH7JCOTJT4SA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031414296 (303h58m56.462494437s) [noise=true , address=89.149.201.147:4022 , piece_id=LHIXBNFSNQ3CNITGGK5WAANLASDPMK6XTAXDPZ5MYRB56DQPSJ4A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.031706434 (303h58m56.462786575s) [noise=true , address=81.171.14.70:4045 , piece_id=5BLSQ7JM7M5XZXOIIS4LNMOQEOP5HC5PKDTALI2LDKXMHIQAFBTQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.041720265 (303h58m56.472800406s) [noise=true , address=89.149.201.147:4020 , piece_id=WTPUOJEEEH5I5PCBIGHQGUYBEAFATZSVDDY2CRQ4LNH7JLA5PQRQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.047790370 (303h58m56.478870511s) [noise=true , address=89.149.201.147:4019 , piece_id=YH4HVEETKLEPWA35GS6N7GXISKYNFBWZ3AFLBHPYUXCSQARBCO5Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.048412099 (303h58m56.47949224s) [noise=true , address=89.149.201.147:4024 , piece_id=QEXK3EVLQM4XKGE325MMW2H3IH3V3KVWTVU2JSMXZ723FLVJMOWQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.052927248 (303h58m56.484007389s) [noise=true , address=81.171.14.70:4028 , piece_id=XSYK2OOKRXMPXNXU7FXMOXX5PVM5FZOHYTY5NGSSVEYDXEU46HPA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.065188018 (303h58m56.496268159s) [noise=true , address=89.149.201.147:4011 , piece_id=ZGHLOUWBWGG6QBW7POKIGV6SEU2UAWMYYI4GCYSUAAQCM3SSJZ7A, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.083998499 (303h58m56.51507864s) [noise=true , address=89.149.201.147:4007 , piece_id=GTNAWJKCSKD7FK4GJ5HP3QPTGZN27HA4QEL66VVEV3ZC2F3TIYJA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084577036 (303h58m56.515657177s) [noise=true , address=89.149.201.147:4008 , piece_id=UFD6KMTZ4RYAI3ZGKQAOP2UWHIS7UVZPNQOAUN3DFOE7GRVD6HEA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.084693098 (303h58m56.515773229s) [noise=true , address=89.149.201.147:4012 , piece_id=7CUBW7VMY4Q23IHB3FQ76AFVAY3LKWQRNGPWMIQJWFEOLSVYMRYQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:02.152607593 (303h58m56.583687725s) [noise=true , address=81.171.14.70:4047 , piece_id=7LERJRDEST2KNDNXCIBTYSIA7MUH6KQ4ITQICWHCMRSRLQ2HYYOA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: <nil> Aug 21 09:25:59.970209376 (303h59m54.401289497s) [noise=true , address=185.167.204.206:4043 , piece_id=IYMQCVK2KUMBH3IXZHNUZX3IQZ4LOZDWIGIFKZHPJKFSSEVSUITQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970242529 (303h59m54.40132266s) [noise=true , address=185.167.204.206:4060 , piece_id=OVW3PJKFJU7DDEPEHJ2NI7YB2XMSQ34LSXJHRN7MBBUF6TI3TCYA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: rpc: dial tcp 185.167.204.206:4060: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970257307 (303h59m54.401337438s) [noise=true , address=185.167.204.206:4071 , piece_id=DJRQVWGFKKPLSZIPFXFDTAB6UQJ2CXEEFQG7B4ZTFAPULLQLUHFQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: rpc: dial tcp 185.167.204.206:4071: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970285360 (303h59m54.401365491s) [noise=true , address=185.167.204.206:4041 , piece_id=UQ356DF727DLQCBMPPBWRUX7VU4V5S3WGW36DF2XCKFSKGB7XMNA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970290601 (303h59m54.401370732s) [noise=true , address=185.167.204.206:4040 , piece_id=QMKNXSFLJ775HE6C2YXJPTCXDVLYLIXC5YUVED463MMKQQFDOZKA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:33230->185.167.204.206:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970315699 (303h59m54.40139582s) [noise=true , address=185.167.204.205:4015 , piece_id=AGHBBB4XLTYMXOYRAEWLZPGZIGYZLWFAHIIMJCEYEGPDCCAHQMDA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1pAUTtyVrPw8FCi8oTE1dsU8avWdehnDdCdtYN4P3zedYoBfiX, address:185.167.204.205:4015): protocol: rpc: dial tcp 185.167.204.205:4015: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970319857 (303h59m54.401399988s) [noise=true , address=185.167.204.205:4036 , piece_id=NRZHG2H5L4BZN6SZERNRSOXIAS2FHKUQJL4TMZO4MNRGPJYWEQ4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: rpc: dial tcp 185.167.204.205:4036: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970347871 (303h59m54.401428002s) [noise=true , address=185.167.204.205:4012 , piece_id=RK7U25EJSWCALVQBDRXB5BSG5CQW3DA3M42VPMHVOXBU6OLQJYLA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: rpc: dial tcp 185.167.204.205:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970373490 (303h59m54.401453621s) [noise=true , address=185.167.204.206:4063 , piece_id=JN2WHWF4M74DB5FQYXDA2FGRPQVNFPQRNI4UAJRLN6AWXXYH3PZQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: rpc: dial tcp 185.167.204.206:4063: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970379561 (303h59m54.401459692s) [noise=true , address=185.167.204.205:4024 , piece_id=PW2BKAX6H6PG76A7WR3Z6L5IL73WEO44MQWVQ4PE6Y6CKO4TXN4Q, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: rpc: dial tcp 185.167.204.205:4024: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970385182 (303h59m54.401465313s) [noise=true , address=185.167.204.206:4049 , piece_id=64H54XD6CXWGJMUDETU2VEMH7Y6VCNSZUMNRX6RINMKI4TYNE2GA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: rpc: dial tcp 185.167.204.206:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970392215 (303h59m54.401472346s) [noise=true , address=185.167.204.206:4059 , piece_id=ZVPH7MXNJO4RRWNRHIWZ74VZFWSYQKUAW3RDLRSJQM2DBHUGPGAQ, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970407885 (303h59m54.401488016s) [noise=true , address=185.167.204.205:4003 , piece_id=AFNLL2L3AICH2AOUVG6OPIBD4FFMINXCO4CTAEQ4FYA4565DK7LA, seg_pos={0 0}, upload=316197]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: write tcp 188.166.225.170:51828->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 21 09:25:59.970428695 (303h59m54.401508826s) [seg_pos={0 0}, upload=316197]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> Aug 21 09:26:00.138485232 (303h59m54.569565363s) [upload=316197]: Done uploading segments... Aug 21 09:26:00.138516251 (303h59m54.569596382s) [upload=316197]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 3.976167218s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)