Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [...........X..X.....X.......X..........X....................] duration: 6.221057673s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 18:02:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 6.221107068s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 714.054168ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 18:02:37 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 714.081862ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [............X..X.....X.......X..........X...................] duration: 6.442720791s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 18:02:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 6.442751209s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.............X..X.....X.......X..........X..................] duration: 6.23595239s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 18:01:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 6.235978611s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 708.656811ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 18:01:28 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 708.686948ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 707.958521ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 18:01:08 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 707.987875ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [..............X..X.....X.......X..........X.................] duration: 9.687936648s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 18:00:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 9.68797001s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 703.929388ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 18:00:44 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 703.96224ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 700.320989ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:59:57 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 700.351216ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [...............X..X.....X.......X..........X................] duration: 6.790775378s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:59:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 6.790804765s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 703.671026ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:59:32 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 703.697437ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 697.394384ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:59:06 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 697.434872ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [................X..X.....X.......X..........X...............] duration: 5.719320847s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:58:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.719356194s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.................X..X.....X.......X..........X..............] duration: 5.787043973s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:58:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.787076916s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 713.912478ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:58:03 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 713.963895ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [..................X..X.....X.......X..........X.............] duration: 5.615104321s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:57:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.615154165s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [...................X..X.....X.......X..........X............] duration: 5.792023004s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:57:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.792053012s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 714.771263ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:56:56 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 714.784688ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [....................X..X.....X.......X..........X...........] duration: 5.798535114s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:56:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.798561715s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.....................X..X.....X.......X..........X..........] duration: 5.715368111s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:56:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.715398157s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 722.392025ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:55:43 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 722.421861ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [......................X..X.....X.......X..........X.........] duration: 5.296668431s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:55:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.296699168s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.......................X..X.....X.......X..........X........] duration: 5.318374663s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:55:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.318406874s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 698.234624ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:54:50 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 698.266416ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [........................X..X.....X.......X..........X.......] duration: 5.770715533s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:54:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.770746893s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 712.615869ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/30eab70780772bd4 FAIL (2025-11-18 17:53:44 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": read tcp 188.166.225.170:40922->45.38.24.2:443: read: connection reset by peer Duration: 712.649243ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.........................X..X.....X.......X..........X......] duration: 5.732017331s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:53:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.732050013s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [..........................X..X.....X.......X..........X.....] duration: 5.633479298s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:52:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.633515196s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [...........................X..X.....X.......X..........X....] duration: 5.810063638s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:52:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.810095177s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [............................X..X.....X.......X..........X...] duration: 5.810736716s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:50:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.81076488s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.............................X..X.....X.......X..........X..] duration: 5.671643729s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:50:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.671677744s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [..............................X..X.....X.......X..........X.] duration: 5.734409958s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:50:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 5.734440246s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [...............................X..X.....X.......X..........X] duration: 1m0.188711024s trace: https://jaeger.dev.storj.io/trace/1672808e7b18f6b7 FAIL (2025-11-18 17:49:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 425857s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648487689 (225h44m57.19995815s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.648948867 (225h44m57.200419328s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653049836 (225h44m57.204520307s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.653709502 (225h44m57.205179963s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.654369940 (225h44m57.205840401s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655164553 (225h44m57.206635014s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.655752162 (225h44m57.207222623s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.656381360 (225h44m57.207851811s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:58.657015407 (225h44m57.208485868s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Uploading piece... Nov 18 17:48:59.925639703 (225h44m58.477110164s) [upload=198823]: Next returned nil segment Nov 18 17:48:59.925658439 (225h44m58.4771289s) [upload=198823]: Waiting for error group managing segments... Nov 18 17:49:00.516140593 (225h44m59.067611054s) [noise=true , address=185.167.204.206:4048 , piece_id=TBETKXWWIAP7QTLHM2MR6O2ELAR5KXJVDZJ6YHA2SZWHHBA43QZQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.525951254 (225h44m59.077421715s) [noise=true , address=185.167.204.205:4024 , piece_id=YOKYH266I5HDH7ODITMSRQH6BRF6SLSYSYTPLJJV2YU2A3UWU4QA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:00.572723186 (225h44m59.124193647s) [noise=true , address=185.167.204.205:4009 , piece_id=PFT2TC5KLIS6KOQO2BYLNO3LTQRZZERXSZQMYOEBEPS3JTFLWKNQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.067060302 (225h44m59.618530763s) [noise=true , address=89.149.201.147:4001 , piece_id=VL52RDB5AZ3RDN43D6ZT57FPWZBSVYJ2T56MPJ6HW4MCQ7SML4SA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.075794143 (225h44m59.627264604s) [noise=true , address=185.167.204.206:4049 , piece_id=IGLUPJ3L5V3TIULP3PQCD2GEEC3B6BWEGUNJ5S7E7KAPALHDRVTQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081180189 (225h44m59.63265065s) [noise=true , address=185.167.204.205:4032 , piece_id=UOFV5UCAVUYM4UDBBGOHXM66KENDHTXG55CJAA7KUQONETTFS4GQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.081984520 (225h44m59.633454981s) [noise=true , address=89.149.201.147:4005 , piece_id=MODXJYLKY4KAIMISPC3SUMRT5EVSP7TMCG4DYSDQII2IHOSHH4TQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.105696722 (225h44m59.657167193s) [noise=true , address=89.149.201.147:4022 , piece_id=ZHX2SXDJ5TKERC3PZ3OYFKNFUDQI77EDLCXEPHMG7KPSWGCW7BUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.191257906 (225h44m59.742728367s) [noise=true , address=89.149.201.147:4019 , piece_id=XKQ54YM73TJPK7S3ODN7F2DMABIBV7DXEBLPZUAWQUR5HTS27T3A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.202193348 (225h44m59.75366381s) [noise=true , address=89.149.201.147:4003 , piece_id=SNGTWOIOJ43WD46C47MDL5AZ23P5V6Z4REGMMHX2MJ3AQZQYHBSA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.272273634 (225h44m59.823744095s) [noise=true , address=185.167.204.206:4061 , piece_id=SGKQYVH2EEOP7EZKBILSN6TAXIOMSBCHXANJRTG6UHFJGZMG2YJA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.305099009 (225h44m59.856569471s) [noise=true , address=185.167.204.205:4035 , piece_id=UFWY2PFFJEAIQEH3HFOA6AAJAJB5XWZHKRLA77P2OES4U3GX5CXA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.821876776 (225h45m0.373347247s) [noise=true , address=185.167.204.205:4021 , piece_id=QOIYSH6CGSUVKSYCPEBTCKPV6K272ABLCXCAVWHTIFWR7OK2BC5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.921180269 (225h45m0.47265073s) [noise=true , address=185.167.204.205:4034 , piece_id=CWYABDK27G7HBIE4JBHNUGSAWRQ4LVM6COXI65XHIYXF4UENCU7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:01.926801301 (225h45m0.478271773s) [noise=true , address=185.167.204.205:4028 , piece_id=IQVISGBQMRJTJCQ65X6CVKFQWPZOXWX5QDWXSAFAWRXPM5WKFTCQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.344156560 (225h45m0.895627021s) [noise=true , address=185.167.204.206:4069 , piece_id=4KNW6MQ6IXIWQOWU7FTEYY5EZY757YNWY3DSSZMGCP3EQAAFVF6A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.349980540 (225h45m0.901451021s) [noise=true , address=185.167.204.205:4015 , piece_id=4BTQP2E7XC2IZPDVVQIQ2F7OZT2LDFASRSATIM3CG6ZTXRGEOKUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:02.888522040 (225h45m1.439992491s) [noise=true , address=185.167.204.205:4002 , piece_id=I7UOJPUNYUTCCKRIQVWQLV7T3QESQEGU2N2F2Q6BBZC642P4WEUQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.342026652 (225h45m1.893497113s) [noise=true , address=185.167.204.206:4046 , piece_id=WNGNA6UGVEUAVMJVRKBLWEATJOX6OKCE2KDUNQ3VUXAVIQ6FP77Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:03.582256503 (225h45m2.133726964s) [noise=true , address=185.167.204.206:4047 , piece_id=VAIEZUOZPZ2DF5FJ2RRFDFMY4IVFUQBZAV7AJA3EZYCXMLVKNMFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.653771287 (225h45m40.205241738s) [noise=true , address=81.171.14.70:4031 , piece_id=24GPZJLCMFY57NBCE3Z3JN7FW73AOQVLZMGHV55NTBSK7JDMIL5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:41.728831976 (225h45m40.280302427s) [noise=true , address=81.171.14.70:4027 , piece_id=XF53EHZZHERKAIRLZYNDXGPMZAQBZKRZZFXIHZMPF6FJEQ6FVUWA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:46.009388378 (225h45m44.560858839s) [noise=true , address=81.171.14.70:4035 , piece_id=BZSYW22GJOT774WJQ3QFJIINYQX5LWMJ4XC63AXPFZBRGG2FCZ5A, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:50.272884604 (225h45m48.824355055s) [noise=true , address=81.171.14.70:4025 , piece_id=GKLEGPL5YPRFVQOF3NQ6I7MHGQ6YYM34NNMZCLY46X3BS4YH6G7Q, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:51.451202409 (225h45m50.00267287s) [noise=true , address=81.171.14.70:4037 , piece_id=FU5WM2VPV6U5J65RELXUJZ6IZ2H2DWZUAKWEIAMXKPCIMV5UTYOQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: <nil> Nov 18 17:49:57.987545771 (225h45m56.539016233s) [noise=true , address=81.171.14.70:4038 , piece_id=LVDTLLPTEU3QFVWOL74Y4LCOBLZPHWYO72KES2IDFGZDOLVWJZAQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35454->81.171.14.70:4038: use of closed network connection Nov 18 17:49:57.988053327 (225h45m56.539523788s) [noise=true , address=81.171.14.70:4045 , piece_id=75QBSUKTJZMS4G7PGRGGICX3IPFVCAH6DQO7S5O5LMQEXEBRTIFA, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49424->81.171.14.70:4045: use of closed network connection Nov 18 17:49:57.988179428 (225h45m56.539649879s) [noise=true , address=81.171.14.70:4039 , piece_id=UZDUYKNGEJQGFLAKFHC4OSPIOMZ4CC25DWA5U363SN5QO2DSKVVQ, seg_pos={0 0}, upload=198823]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38536->81.171.14.70:4039: use of closed network connection Nov 18 17:49:57.988220887 (225h45m56.539691348s) [seg_pos={0 0}, upload=198823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Nov 18 17:49:58.172771756 (225h45m56.724242217s) [upload=198823]: Done uploading segments... Nov 18 17:49:58.172825708 (225h45m56.724296169s) [upload=198823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1m0.188738376s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [................................X..X.....X.......X..........] duration: 5.780691314s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:48:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 5.780721132s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.................................X..X.....X.......X.........] duration: 5.751075873s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:47:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 5.751101521s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..................................X..X.....X.......X........] duration: 5.773945649s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:46:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 5.773986388s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...................................X..X.....X.......X.......] duration: 5.736028509s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:45:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 5.736116927s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [....................................X..X.....X.......X......] duration: 6.298482681s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:45:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 6.298509784s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.....................................X..X.....X.......X.....] duration: 6.104297099s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:44:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 6.104323418s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [......................................X..X.....X.......X....] duration: 6.085867073s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:43:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 6.085897852s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.......................................X..X.....X.......X...] duration: 7.053128543s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:43:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 7.053161335s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [........................................X..X.....X.......X..] duration: 6.220977199s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:42:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 6.221086535s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.........................................X..X.....X.......X.] duration: 5.982707811s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:41:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 5.982739339s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..........................................X..X.....X.......X] duration: 1m0.173064101s trace: https://jaeger.dev.storj.io/trace/52908a80e46d0499 FAIL (2025-11-18 17:41:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 18) ======LOGS====== 8 17:40:33.138244254 (225h36m31.689714715s) [upload=198696]: Waiting for error group managing segments... Nov 18 17:40:33.718840913 (225h36m32.270311374s) [noise=true , address=185.167.204.205:4001 , piece_id=NO3VJAPFEMQFMTHWT5BLE6FCP5IGAX2MMNN5CB5Y3E7AX43PG73Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.261944929 (225h36m32.81341539s) [noise=true , address=89.149.201.147:4009 , piece_id=XDGCYFXTNIWDDFIURROCMQEHTV6AGKNR6OMO5UOVVEXRIN7RRMJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.318621182 (225h36m32.870091643s) [noise=true , address=89.149.201.147:4005 , piece_id=MEKC2XDAUPWN2OPXYPNPY457NUWFSDD5CNUFRV4QQJDGVMWAS3AQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346199135 (225h36m32.897669596s) [noise=true , address=89.149.201.147:4021 , piece_id=WXP33LN5MZZEWK34JUV4RIWIIC6GEN6UKSG4YQXV2FLFV4XW4MUQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.346885682 (225h36m32.898356153s) [noise=true , address=89.149.201.147:4014 , piece_id=QUDGXCDQ7CNYRQEGMZNO75WGDUGCUGNKAXWRRA7MIO6JY5CQP3FQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.347645568 (225h36m32.899116029s) [noise=true , address=89.149.201.147:4022 , piece_id=VMMMDIR537VJYCCLB6AFJ45JISTVYX4ULJJPTDWSOZWJSSJ2CBAA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.365915227 (225h36m32.917385688s) [noise=true , address=89.149.201.147:4001 , piece_id=XSARE5C4QTNQ4AGDSGXKJG2XDO4H5OCPMY7SFIIOH4CV2Z7XBKEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.704090173 (225h36m33.255560634s) [noise=true , address=89.149.201.147:4023 , piece_id=56JCU2GLRZL5SBLJQ2JBPUYY5ZCYNLCSOWZB7U6CPUBMOZQT36GA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:34.733917149 (225h36m33.28538761s) [noise=true , address=185.167.204.205:4034 , piece_id=RZM5JWFM6TIPWJEVZSIFZ5ET4GS54EYBSKNOHVMRLDJW7BQMBD6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.010722665 (225h36m33.562193117s) [noise=true , address=185.167.204.206:4066 , piece_id=UEXXGXAOAURYZGHI674L6QV3IYPIHK3CC5B6D3IYKRDGACE3UDOA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.343574645 (225h36m33.895045106s) [noise=true , address=185.167.204.206:4041 , piece_id=PW7DR5QSOA7U4UBQHCAOAR4OKLR3MZ2YEZIXLALGT5IKWZBBAW4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.644601634 (225h36m34.196072105s) [noise=true , address=185.167.204.206:4067 , piece_id=YTONMGVD2KQJPSKPV5UMWYTPQ2L5ZQWC72NZRWFAXDNNMACEPZEA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.704393548 (225h36m34.255864019s) [noise=true , address=185.167.204.206:4048 , piece_id=Z46WXFHAXGIA6F46A6Z6OAMKAHBEXIJ4BN6VC3G4BFGUJEYSDKJA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:35.708352787 (225h36m34.259823248s) [noise=true , address=185.167.204.205:4030 , piece_id=GBO2NFXLFPFZ4VOQMXH7UPL7JXUD6C4RJUWLA56ENS5KRY3UQ6CA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.079000266 (225h36m34.630470737s) [noise=true , address=185.167.204.205:4032 , piece_id=ANVQVKT476KKBLHOPELSR6MU73KBH7FM5HOYTFTSBCAXEADWAJKQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.140881890 (225h36m34.692352351s) [noise=true , address=185.167.204.205:4016 , piece_id=QKU64VVMPIEG5Q7LZXGLPQBDRWMVJM3BBEOXUANMRBTLCAMZS4ZQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:36.856559116 (225h36m35.408029577s) [noise=true , address=185.167.204.205:4017 , piece_id=NT6YVOSTI7IAU2FTDKIHXNG6IF5OY34P64NS6GA3LK3VYOUEINUA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:40:37.315460647 (225h36m35.866931108s) [noise=true , address=185.167.204.206:4059 , piece_id=KQZJ6XAHTIXE4IPSLQYVVN4IJPZQVLEKV5L2QSNFWUEOJ3INUCYA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: <nil> Nov 18 17:41:31.193477297 (225h37m29.744947758s) [noise=true , address=81.171.14.70:4035 , piece_id=27QR3LOO3ZP2ZZPZHZ7OY626NUR6YK7VPQRK6RL2PSVR5ZO5VJQA, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56290->81.171.14.70:4035: use of closed network connection Nov 18 17:41:31.193501093 (225h37m29.744971594s) [noise=true , address=81.171.14.70:4038 , piece_id=WXCP5B3QQYXMVYOCU5Y7I5WUSRNUWM7UGOQLAJ3QA2MWVJ4QN44Q, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB, address:81.171.14.70:4038): protocol: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->81.171.14.70:4038: use of closed network connection Nov 18 17:41:31.193662120 (225h37m29.745132581s) [noise=true , address=81.171.14.70:4039 , piece_id=WRWXPRW23S47UG7B7TIR466BRLDKEABSW6IL4GVNSCMS3QCH4G4A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59924->81.171.14.70:4039: use of closed network connection Nov 18 17:41:31.193763773 (225h37m29.745234234s) [noise=true , address=81.171.14.70:4028 , piece_id=BINW7G6D5EH52345ON3OBJQILNUJTO6IRHNEITLFLZXP4RAIDA6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53560->81.171.14.70:4028: use of closed network connection Nov 18 17:41:31.193944237 (225h37m29.745414708s) [noise=true , address=81.171.14.70:4046 , piece_id=POWKHLYIDO6EMHAMTYHAVTW74WSIM3B2JS7MTQRKB3VYFOM27O7A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:47024->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194023377 (225h37m29.745493868s) [noise=true , address=81.171.14.70:4029 , piece_id=OPTEL2NOZ3BLHXJIM3AGJDBLEJDTKUPNYCJ3I5UEDY7F4YP7G6CQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39396->81.171.14.70:4029: use of closed network connection Nov 18 17:41:31.194134599 (225h37m29.74560506s) [noise=true , address=81.171.14.70:4027 , piece_id=XLK77RMF2HGX4X2YKH7EPJFPMTHYGQFYLBNJNHGDVXIRNOKLNZCQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:43028->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194206866 (225h37m29.745677327s) [noise=true , address=81.171.14.70:4025 , piece_id=LJFNR5T43GS3H75IWVRZ7B2W6HQR6ZEL6XX6DT5YKBP43PIIGGQQ, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: read tcp 188.166.225.170:54040->81.171.14.70:4025: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194304893 (225h37m29.745775354s) [noise=true , address=81.171.14.70:4033 , piece_id=YT4CK3NBBXWGQLURDZ4OS5DWZD2X5DHZSMBMGDT2JTZECZYWDJ5A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 188.166.225.170:50880->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194547245 (225h37m29.746017706s) [noise=true , address=81.171.14.70:4034 , piece_id=MARVAXNKROHFSJM5Q3IAGBNHGUNELMRADKQCOQE7S7ZXBLYDLU6A, seg_pos={0 0}, upload=198696]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:47078->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:41:31.194581780 (225h37m29.746052231s) [seg_pos={0 0}, upload=198696]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil> Nov 18 17:41:31.364107237 (225h37m29.915577688s) [upload=198696]: Done uploading segments... Nov 18 17:41:31.364154558 (225h37m29.915625019s) [upload=198696]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18) Duration: 1m0.173091434s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X..X.....X.......] duration: 6.123946445s trace: https://jaeger.dev.storj.io/trace/31941f458ea9f65a FAIL (2025-11-18 17:40:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ding piece... Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments... Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011 , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020 , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022 , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015 , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028 , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040 , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037 , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044 , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047 , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027 , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments... Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 6.123979688s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [............................................X..X.....X......] duration: 6.357018735s trace: https://jaeger.dev.storj.io/trace/31941f458ea9f65a FAIL (2025-11-18 17:39:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ding piece... Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments... Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011 , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020 , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022 , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015 , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028 , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040 , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037 , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044 , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047 , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027 , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments... Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 6.357052819s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X..X.....X.....] duration: 6.30021064s trace: https://jaeger.dev.storj.io/trace/31941f458ea9f65a FAIL (2025-11-18 17:38:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ding piece... Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments... Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011 , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020 , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022 , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015 , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028 , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040 , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037 , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044 , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047 , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027 , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments... Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 6.300259874s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..............................................X..X.....X....] duration: 6.332628289s trace: https://jaeger.dev.storj.io/trace/31941f458ea9f65a FAIL (2025-11-18 17:37:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ding piece... Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments... Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011 , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020 , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022 , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015 , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028 , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040 , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037 , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044 , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047 , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027 , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments... Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 6.332663288s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...............................................X..X.....X...] duration: 5.831392769s trace: https://jaeger.dev.storj.io/trace/31941f458ea9f65a FAIL (2025-11-18 17:37:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ding piece... Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments... Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011 , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020 , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022 , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015 , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028 , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040 , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037 , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044 , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047 , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027 , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments... Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 5.831448024s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [................................................X..X.....X..] duration: 6.187153322s trace: https://jaeger.dev.storj.io/trace/31941f458ea9f65a FAIL (2025-11-18 17:36:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ding piece... Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece... Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments... Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011 , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020 , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023 , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022 , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009 , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015 , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028 , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040 , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil> Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037 , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042 , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045 , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044 , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047 , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027 , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments... Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 6.187174722s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)