Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.305752346s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:23:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.305796411s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 95.773773ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:22:45 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 95.815183ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.71988351s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:22:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.71991041s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 430.494332ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:22:41 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 430.513027ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 232.148499ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:22:13 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 232.173388ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 66.333784ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:21:47 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 66.36323ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.452943589s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:21:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.45297539s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 69.901197ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:21:15 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 69.932807ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 232.514847ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:21:00 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 232.545153ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.472171553s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:20:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.472201429s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.068636445s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:19:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.068757657s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.822710454s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:18:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.822741371s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.117320833s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:18:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.117354057s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.11222963s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:17:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.11231864s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.763411286s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:17:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.763447647s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.858600965s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:16:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.858684624s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.374773005s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:15:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.374803744s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.885514212s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:14:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.885533591s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.953794134s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:13:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.953819994s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.93571667s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:13:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.93574786s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.842709954s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:12:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.842745161s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.350391653s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:11:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.350424464s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.048519545s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:11:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.048542378s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.174934911s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:11:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 1m0.174959258s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 64.087597ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:40:23 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 64.113106ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 109.664454ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:40:03 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 109.702136ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 60.132244ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:39:28 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 60.19883ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 117.520916ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:38:54 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 117.546324ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 75.550013ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:38:28 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 75.576263ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 61.338341ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:37:20 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 61.366214ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 76.968584ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:36:47 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 76.995917ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 69.858456ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:35:33 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 69.884556ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 68.209666ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:34:58 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 68.235976ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 71.81959ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:34:41 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 71.850449ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 93.98689ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:34:06 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 94.021858ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 76.626923ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:33:10 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 76.743506ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 60.7969ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:32:08 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 60.825645ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 102.547ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:31:18 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 102.581086ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 690.366512ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/c90299653e0937c FAIL (2025-11-07 11:30:09 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:44186->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 690.47071ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 335.069943ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:27:53 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 335.132101ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 319.213851ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:27:16 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 319.247204ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 337.622213ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:26:54 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 337.647011ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 360.283973ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:26:34 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 360.317757ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 328.912286ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:25:31 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 328.968774ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 333.076437ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:25:16 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 333.110312ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 328.014938ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:24:30 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 328.040317ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 371.924951ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:23:47 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 371.952634ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 320.649384ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:23:17 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 320.671285ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [X........X.....] duration: 348.120796ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/51bb8fafefe354b5 FAIL (2025-11-07 11:22:48 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:44092->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 348.137297ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 90.953965ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/1787d36c366285be FAIL (2025-11-07 11:22:24 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:33036->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 90.979563ms core website

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)