Orbiter History

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [....X.......X..] duration: 322.214627ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/67002088192cf76 FAIL (2025-11-07 12:38:09 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:47682->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 322.260673ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [.....X.......X.] duration: 329.199747ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/67002088192cf76 FAIL (2025-11-07 12:37:28 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:47682->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 329.225516ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.940193354s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:37:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.940228571s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [......X.......X] duration: 433.623863ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/67002088192cf76 FAIL (2025-11-07 12:37:10 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:47682->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 433.652087ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 315.829437ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:36:29 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 315.859082ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.094109718s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:36:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.09415315s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.930873322s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:36:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.930908879s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 323.732136ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:35:59 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 323.764948ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.944212534s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:35:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 4.944248543s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 353.699561ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:34:52 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 353.731721ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 322.780904ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:34:34 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 322.807746ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.749717058s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:34:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.749750102s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 334.175171ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:33:41 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 334.20576ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.33529306s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:33:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.335322056s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.355429511s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:32:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.355459418s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [X...........X..] duration: 346.103295ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:32:40 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 346.130979ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [.X...........X.] duration: 342.312296ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:32:18 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 342.370468ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.464137884s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:31:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.464165437s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 2 out of 15 is failed (threshold=6) [..X...........X] duration: 231.994859ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/54bd85567f11aa22 FAIL (2025-11-07 12:31:34 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:39638->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 232.027912ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.77203284s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:30:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.772062505s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 90.810774ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:30:46 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 90.829749ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 349.200403ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:30:27 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 349.232514ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 349.569056ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:30:12 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 349.600836ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.301900547s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:30:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.301939512s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 105.027806ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:29:58 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 105.048516ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.452238807s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:29:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.452271441s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 354.196787ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:29:03 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 354.231001ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 105.249929ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:28:54 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 105.285426ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 343.393434ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:28:28 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 343.421971ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.855146761s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:28:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.855179955s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 73.898749ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:27:44 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 73.926822ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.297703719s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:27:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.297737123s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 323.852014ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:27:15 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 323.871521ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.786774555s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:27:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.786803619s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 67.132305ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:26:58 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 67.170827ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 320.330669ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:26:53 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 320.359023ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 134.320385ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:26:36 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 134.345011ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 64.839438ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:26:19 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 64.854085ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 331.393053ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:26:09 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 331.425546ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.526390098s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:25:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.526423151s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 70.008321ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:25:29 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 70.038709ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 69.829259ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:25:12 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 69.857794ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.034233269s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:25:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 6.03426554s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 330.56038ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:25:00 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 330.594313ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 61.650566ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:24:32 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 61.680573ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 347.953568ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:24:29 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 347.97553ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.992411645s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:24:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.992454826s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 634.781551ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/dcs-satellites trace: https://jaeger.dev.storj.io/trace/370e67e0f975b755 FAIL (2025-11-07 12:23:54 UTC) orbiter warning: Get "https://www.storj.io/dcs-satellites": read tcp [2400:6180:0:d0::f70:8001]:37596->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 634.811419ms core website
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.837168699s trace: https://jaeger.dev.storj.io/trace/5543d31a35a891b5 FAIL (2025-11-07 12:23:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== Nov 7 12:10:18.488089199 (192h29m50.183937952s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.488844667 (192h29m50.184693421s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.489493093 (192h29m50.185341846s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.491059355 (192h29m50.186908108s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.492900661 (192h29m50.188749414s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.495441359 (192h29m50.191290112s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496103099 (192h29m50.191951862s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.496777934 (192h29m50.192626687s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.497351987 (192h29m50.193200741s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:18.498070184 (192h29m50.193918937s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Uploading piece... Nov 7 12:10:19.348473350 (192h29m51.044322104s) [upload=169667]: Next returned nil segment Nov 7 12:10:19.348532172 (192h29m51.044380945s) [upload=169667]: Waiting for error group managing segments... Nov 7 12:10:19.742677197 (192h29m51.438525961s) [noise=true , address=89.149.201.147:4019 , piece_id=Y2LHQD2KQESRPNW4LIZ6WM3DO5GD5DKNVNQSZ3IFTSI6YETJCOYQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.754436920 (192h29m51.450285673s) [noise=true , address=89.149.201.147:4023 , piece_id=MRO6M7SBCBRMUQNWO4CKITPJ5E2KFS5VXRXEEQHL6JIDXOGIXUQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.761250905 (192h29m51.457099658s) [noise=true , address=81.171.14.70:4032 , piece_id=ZQ6KMJZHHNH5NAI2FMS4FEUHZ24ECCWRJ4M6CTGZWDWLZVUVECUQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.768270693 (192h29m51.464119446s) [noise=true , address=89.149.201.147:4012 , piece_id=RESDWMLGAEHHDP537NXDHUQ6OKYHKDDWTBURYKBH6ZBMV66X5VNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.778341510 (192h29m51.474190263s) [noise=true , address=81.171.14.70:4027 , piece_id=Y2XXWG7J3KFHHBYAQF7NOZ2MMSD2LH43TDRJPR2DAKPI34MLNWFQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.779052383 (192h29m51.474901136s) [noise=true , address=89.149.201.147:4007 , piece_id=E5ZZPVNYADWNNZZCZQKX4UU6PWR5H23J24RVJMOEEWDQEB3VAN2Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.781789345 (192h29m51.477638098s) [noise=true , address=81.171.14.70:4043 , piece_id=FZWOIXLJPMBDD5ZCKMM4CC2DBNH2E7M62LSDNEKHVA6V2PGS64QQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.783722446 (192h29m51.479571189s) [noise=true , address=89.149.201.147:4015 , piece_id=AJM2BHOTMXS53PAL7SCQ3HTGI7APCRSJAEUWJJ2P6CXIRDBXEBLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.785650367 (192h29m51.48149912s) [noise=true , address=81.171.14.70:4030 , piece_id=GPRVTARY3MIWYWPTGQOMOBJV34MOPWE5L54SAYBA3OVPSN4TRJHA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.787149342 (192h29m51.482998095s) [noise=true , address=81.171.14.70:4034 , piece_id=WCRV45E2ZGDB46IJUFCFVSY6LC4H2T4VS7RTNPLXGJUJSX6C7JCA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.797320890 (192h29m51.493169643s) [noise=true , address=81.171.14.70:4028 , piece_id=2VRTJI6RVTRVQ355I7EKEA7WIVGJVFDSSQJDN7IOWMY7JNEIPILQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.798553828 (192h29m51.494402581s) [noise=true , address=81.171.14.70:4025 , piece_id=NN4TBLCJ5445YOVETGNCJCCSBFRAI7NRDB4YDFSO4NX2LHY6OUKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:19.800549067 (192h29m51.49639782s) [noise=true , address=89.149.201.147:4016 , piece_id=VZA7JXA3DRATIU4JVLRRHSANBLYHEJAHHFI2FKUWNZYGAHDV2V3A, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.199079032 (192h29m51.894927775s) [noise=true , address=81.171.14.70:4031 , piece_id=L6ZMSMURDQ6GPA433SXSDXU6QMG5ZWFMDPVZ62DOC7SULCLYY4VA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.274663611 (192h29m51.970512364s) [noise=true , address=81.171.14.70:4038 , piece_id=3MVMDWOOZDMGQQHYQGBYC5DCIUS7HBXHJUJIUT3WXWKD6UUZRYCQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.332395846 (192h29m52.028244599s) [noise=true , address=89.149.201.147:4017 , piece_id=ESXRXKTWZK5AZKB7G56F4XB63743MACPHUUVXM5RXXSONZDHDQIQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973041600 (192h29m52.668890353s) [noise=true , address=185.167.204.205:4028 , piece_id=HJCJIZ66G3I4JVO43X6RZYYWAZHCWWK5R7J5MB6LOLDPPVUULXQA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:20.973124739 (192h29m52.668973492s) [noise=true , address=185.167.204.205:4027 , piece_id=VCRARCVXLTP2R3SQPHPGKJ7AUCQYINL46EVRPFE4DQJEZSFHSE7Q, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.001872630 (192h29m52.697721383s) [noise=true , address=185.167.204.205:4010 , piece_id=2JCWN2NZFFQGBJIV2FFY4LDJ4TTFEA5WSZUY33P6APGFJMDGANWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.002017226 (192h29m52.697865979s) [noise=true , address=185.167.204.205:4021 , piece_id=6DVHTFZWC6ED53FQA33VMPKJSNOJNJ4HMUBGT4FFPIJMBNSNICHQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.039563082 (192h29m52.735411835s) [noise=true , address=185.167.204.205:4017 , piece_id=KTJP6OKYOA4NNY2ADTIWMTJEZ7SSECKFNXSFZ6OKLGKDZCFGWLJQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.079690322 (192h29m52.775539065s) [noise=true , address=185.167.204.206:4043 , piece_id=UXU7WTOK2KAJCJ3WDP4KIPE5CBNTSRCWO5RNGSQEVM5WUDM5UGNA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:10:21.091957361 (192h29m52.787806114s) [noise=true , address=185.167.204.205:4006 , piece_id=6ZDY3QJYPSLOHWDEGRTBDU66LHZLUWY3WRSBEDSBVDN7FN2M2RKQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: <nil> Nov 7 12:11:17.819183723 (192h30m49.515032476s) [noise=true , address=185.167.204.205:4018 , piece_id=36Y52K7EORT2XDQ5WELKL3PO3WH3X7SHUG5G5DMVVB5UC2JGEEKA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: write tcp 188.166.225.170:42210->185.167.204.205:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.819640622 (192h30m49.515489375s) [noise=true , address=185.167.204.205:4029 , piece_id=7LWWMV5YISQUWCAGPHTFQ7JDDFMOY4H3CQWAGZYK4CM3PYOVKAWQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: write tcp 188.166.225.170:37438->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820006550 (192h30m49.515855313s) [noise=true , address=185.167.204.206:4060 , piece_id=SNLN7SD5EHSM2JJULEUX3AF3IKB26RI7A7M4QIFVUQBLOAC6VSLA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: write tcp 188.166.225.170:42000->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 7 12:11:17.820172745 (192h30m49.516021498s) [noise=true , address=185.167.204.205:4011 , piece_id=7TV3EQUWBUJALNSWZT6JLJ2MTBKWK7V75COUIVODCGTB6VBO7NJA, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820425578 (192h30m49.516274331s) [noise=true , address=185.167.204.206:4041 , piece_id=N6WD45GUTAQMK3A644N7TNMUMTDZ5TDJ43HHRTXVKENBE4SEHBAQ, seg_pos={0 0}, upload=169667]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: context deadline exceeded; context deadline exceeded Nov 7 12:11:17.820461987 (192h30m49.51631074s) [seg_pos={0 0}, upload=169667]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 7 12:11:17.991461014 (192h30m49.687309767s) [upload=169667]: Done uploading segments... Nov 7 12:11:17.991501130 (192h30m49.687349884s) [upload=169667]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 5.837196612s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 90.712876ms remote: "tcp:[2620:cb:2000::1]:443" target: https://www.storj.io/ trace: https://jaeger.dev.storj.io/trace/133811f3a2300a1a FAIL (2025-11-07 12:23:43 UTC) orbiter warning: Get "https://www.storj.io/": read tcp [2400:6180:0:d0::f70:8001]:46402->[2620:cb:2000::1]:443: read: connection reset by peer Duration: 90.734117ms core website

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)