Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.X.......................] duration: 3.683219857s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:41:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 3.683243803s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.X......................] duration: 4.506452316s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:39:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.506476323s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.X.....................] duration: 4.497152175s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:39:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.497179248s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.X....................] duration: 3.62577462s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:38:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 3.625797824s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.X...................] duration: 4.152855984s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:37:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.152893125s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration: 5.349038399s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:36:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 5.349063528s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.X.................] duration: 4.940780971s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:35:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.940798635s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.X................] duration: 5.402761567s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:35:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 5.402791274s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.X...............] duration: 3.67735578s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:34:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 3.677391039s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.X..............] duration: 4.16317515s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:33:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.163204196s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.X.............] duration: 4.635989356s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:32:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.636012261s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.X............] duration: 4.177147254s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:32:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.177174618s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X.X...........] duration: 4.117284992s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:31:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.117312986s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X.X..........] duration: 4.168267306s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:31:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.16829494s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [................................................X.X.........] duration: 5.035656662s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:30:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 5.035685978s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X.X........] duration: 4.63108998s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:29:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.631104869s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X.X.......] duration: 4.964129051s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:29:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.964155041s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X.X......] duration: 4.155732132s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:28:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.155750105s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X.X.....] duration: 4.527937071s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:27:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.527964836s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration: 5.016444064s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:27:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 5.016473642s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X.X...] duration: 4.097615143s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:26:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.09764484s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration: 4.600721162s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:25:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.600749496s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X.X.] duration: 4.150702808s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:24:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.150718428s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................X.X] duration: 1m0.169753774s trace: https://jaeger.dev.storj.io/trace/71e8b0fffa13491b FAIL (2026-04-05 19:24:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.445047209 (728h18m29.35738484s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:46.446660112 (728h18m29.358997743s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Uploading piece... Apr 5 19:23:47.230997446 (728h18m30.143335087s) [upload=698890]: Next returned nil segment Apr 5 19:23:47.231015220 (728h18m30.143352852s) [upload=698890]: Waiting for error group managing segments... Apr 5 19:23:47.620452706 (728h18m30.532790347s) [noise=true , address=185.167.204.205:4003 , piece_id=POAEFTZYX3ULC346GTXGT35G2C3CNGGKDBDH24MMLG3L5K6XEUQQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620924707 (728h18m30.533262338s) [noise=true , address=185.167.204.205:4006 , piece_id=OH4TLM4XGF4RFSIMJUCOZTRZAJ2VXSD5IZ272D5O4ZTRJV2EKXFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.620995212 (728h18m30.533332843s) [noise=true , address=185.167.204.205:4036 , piece_id=VNGVFT6CPVAFI22JM7YP632ZHFHF63TYOS5OHMPN6SIJYI47Z6ZA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.623436224 (728h18m30.535773855s) [noise=true , address=185.167.204.206:4052 , piece_id=MURH7U3OF7FDWXLNFX2D62OLQXZBRHF5IH2B7O2NIDHYXYVMWPZQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.627891562 (728h18m30.540229193s) [noise=true , address=185.167.204.206:4064 , piece_id=R7LLF3HEHD6HVO4YOBXMNVUSXSOHZL4BDX2RSIL2SKGS3YLPJWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.628832688 (728h18m30.541170319s) [noise=true , address=185.167.204.206:4057 , piece_id=FVDAYDB2M3BS75XT6IWQRSP2QUEVFHSUF3EYAYHHQP37Z2OHS5XA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.629152575 (728h18m30.541490206s) [noise=true , address=185.167.204.206:4069 , piece_id=MWVVC2BOZMC4TWXPVELWHD4RZTBSMYR53CJSIPGQ25B7VDBTMQIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641386105 (728h18m30.553723736s) [noise=true , address=185.167.204.206:4043 , piece_id=VZKY2PYLTFYRGF2JGYWNSHRPEAX6GYTKW7ASDQL7ZALAXXXKNYFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.641788261 (728h18m30.554125902s) [noise=true , address=185.167.204.205:4024 , piece_id=2N453JCGF4QS3LKGEZ7BDQZ45NRDPUTBZWECWUKOYBPBRLHJUD3Q, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.643005260 (728h18m30.555342891s) [noise=true , address=185.167.204.205:4011 , piece_id=BG66DKR26PWXMAFTAONWEUFPU6SMOOKMIZWNZSGOIRX2IMUJR4FQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.645249922 (728h18m30.557587553s) [noise=true , address=185.167.204.206:4065 , piece_id=EFD2RBNEIUL4XJ3J4R74552BXEVHR22INNGBRRWNEB7YJFCXKFFA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651359453 (728h18m30.563697084s) [noise=true , address=185.167.204.206:4056 , piece_id=J5L4SVTQZY7WSPSQ2GXOV7MDN4DIYE454N6FT6K7ZGUD7HR2BFHA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.651412215 (728h18m30.563749846s) [noise=true , address=185.167.204.205:4034 , piece_id=VNTYO6Q4IMH2T2XEHJWH64F3YUL45BBCNQLZ46WUZAX62V2SMFTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.654801867 (728h18m30.567139498s) [noise=true , address=185.167.204.206:4071 , piece_id=5NSML2UJOWKUN3FUGXXD37NU3MARIKY6TDCLCDXC6S6WVFV7C5RA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.655101795 (728h18m30.567439426s) [noise=true , address=185.167.204.205:4014 , piece_id=N3MPWVZ2RTISLPAJFFSURQNRNDWY6KMBFZOONAX3U74GLSFZKWDA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.658113638 (728h18m30.570451269s) [noise=true , address=185.167.204.206:4055 , piece_id=VIYGDMLV7V3V76NZ3V5IWBICO6CT7YNTP4BN5QHI542HNFVJ3PTA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.662924132 (728h18m30.575261763s) [noise=true , address=185.167.204.206:4062 , piece_id=GRRUPYUEBCY2S6JPGJOEXNJ3OZZDZBYVX27AEMW5YV6IKGEZ6ZQA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.666865058 (728h18m30.579202689s) [noise=true , address=185.167.204.205:4033 , piece_id=EO2VKCTXXE7MA4UOPWABIV23LJDKGMKIUNV3KGFS47OIVXB5WVKQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:47.670168473 (728h18m30.582506104s) [noise=true , address=185.167.204.205:4009 , piece_id=YQ6P3DOBAPZKVCVTTBI2IJH2UMWWLMLWXMIJNRNSADDSHYF2KGAQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:23:51.907352601 (728h18m34.819690232s) [noise=true , address=89.149.201.147:4003 , piece_id=EDENB2NCQRRUJEKQGC7DMMX6ZF4IIWV6WUV7YTW7W55BJQU7QNWQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: <nil> Apr 5 19:24:45.775054746 (728h19m28.687392447s) [noise=true , address=89.149.201.147:4011 , piece_id=FZK5PMW5EYIQLVOLCUOIWR2S42I7BLHX6FRV2MFOTPUKYF36GH2A, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48780->89.149.201.147:4011: use of closed network connection Apr 5 19:24:45.775168405 (728h19m28.687506076s) [noise=true , address=81.171.14.70:4048 , piece_id=MUDLJPWEYZYTMXLJJZ4FFOTGGVMXZVJSHXE5FZPNHE2SIW6LKPLA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:24:45.775267757 (728h19m28.687605408s) [noise=true , address=81.171.14.70:4045 , piece_id=3S6DJCM2FVYHVTFA64VBAWELYHHNKC6RZXBLCUUJS7XY3GACRPIQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33260->81.171.14.70:4045: use of closed network connection Apr 5 19:24:45.775492000 (728h19m28.687829631s) [noise=true , address=81.171.14.70:4046 , piece_id=LMHJQTHJ7JYY35M3F7XWYVD274OKDBDKCSPTPVW75OD45I37WREQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 188.166.225.170:50152->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.775746100 (728h19m28.688083781s) [noise=true , address=81.171.14.70:4047 , piece_id=4GRNNNHVJEPJWTCB6GN65XBRL3TOOFNJEGSC3FNZOACHAFUAPOKA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56156->81.171.14.70:4047: use of closed network connection Apr 5 19:24:45.776021131 (728h19m28.688358762s) [noise=true , address=81.171.14.70:4031 , piece_id=JOJX7BWJCEIZQPIFFUSB7ZTDB6EY53JN4W4QSQGXTALSWTZYPVPA, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36640->81.171.14.70:4031: use of closed network connection Apr 5 19:24:45.776035619 (728h19m28.68837329s) [noise=true , address=89.149.201.147:4002 , piece_id=L5JCOBLFBXEHYW54OA7WH7ZDH75VSJ2HJJDUXT64TGXWF3TNKSRQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33962->89.149.201.147:4002: use of closed network connection Apr 5 19:24:45.776457844 (728h19m28.688795475s) [noise=true , address=81.171.14.70:4041 , piece_id=U7R4MJPROP5OVX3ZNJS2QFUBBBWMH52G36ISP3QICJSUZ7VO5EDQ, seg_pos={0 0}, upload=698890]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:57676->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:24:45.776489063 (728h19m28.688826735s) [seg_pos={0 0}, upload=698890]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Apr 5 19:24:45.942762431 (728h19m28.855100052s) [upload=698890]: Done uploading segments... Apr 5 19:24:45.942795364 (728h19m28.855132995s) [upload=698890]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1m0.169770637s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.171871836s trace: https://jaeger.dev.storj.io/trace/59f818d5713f8a13 FAIL (2026-04-05 19:22:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== :21:37.498494987 (728h16m20.410832628s) [noise=true , address=185.167.204.205:4010 , piece_id=GECSCX24DVYUJDRNFW5U3FEQM3NMGUFLYRNGCR2BC745KFXONFYQ, seg_pos={0 0}, upload=698863]: Uploading piece... Apr 5 19:21:38.287074633 (728h16m21.199412264s) [upload=698863]: Next returned nil segment Apr 5 19:21:38.287089301 (728h16m21.199426922s) [upload=698863]: Waiting for error group managing segments... Apr 5 19:21:38.667740817 (728h16m21.580078458s) [noise=true , address=185.167.204.205:4008 , piece_id=PH3TL2YHM7K6CVQDHZFHECMY4QSHWJCF3KDKSJWMTUYONUNCWP4Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.671155557 (728h16m21.583493188s) [noise=true , address=185.167.204.205:4014 , piece_id=HABYZFBFKIXRMRPE7LIUGBRRO2ODUGXO72CWCNVMRHPPOPZDMPNQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.678777597 (728h16m21.591115228s) [noise=true , address=185.167.204.206:4069 , piece_id=CMDVU44LRTBCYO4RCZPQIR3IJT7IHDDXRZA44VHKYZITSV5PAJTA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.687073288 (728h16m21.599410919s) [noise=true , address=185.167.204.206:4071 , piece_id=XWUJZHSDBOVAMBOHJ76UNIYDEYFZSWD4IQCXJ5I66P6XRFPHAF6Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.689769191 (728h16m21.602106822s) [noise=true , address=185.167.204.206:4044 , piece_id=SR576JELJVLHID5UJKBN42ZXWK3CDOVA67PFYBSJNE25OXAYWL7A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.692924742 (728h16m21.605262373s) [noise=true , address=185.167.204.206:4072 , piece_id=7YNMSVBIM5EIF5Z52Q2O7VRKAQJAZ2GMDZPWQ45ZFEEVOKE7YWLA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.694064211 (728h16m21.606401842s) [noise=true , address=185.167.204.206:4058 , piece_id=KEXK3ME2VECOP6C5B5OMCHD2V45ZGQB67F4QEGSPHZHLSOVGHSMA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.697829938 (728h16m21.610167569s) [noise=true , address=185.167.204.205:4029 , piece_id=RUNVBCA6FSTQ7G2FOIQKI2FUAFMWMNHIDDF5KMY2EJB7U2JCAGIA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.698200975 (728h16m21.610538606s) [noise=true , address=185.167.204.206:4037 , piece_id=LOP2TWLKUIGHRF5BOJTSP33J2GNFUZTQ34Z7FPNCC2K254V6CU6A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.700560438 (728h16m21.612898069s) [noise=true , address=185.167.204.205:4019 , piece_id=2G5DVHGFZYKINUGPYM33S3MTZSAJLSTWFSMMFPCGWHJAFPJKYP6A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.701187339 (728h16m21.61352499s) [noise=true , address=185.167.204.205:4010 , piece_id=GECSCX24DVYUJDRNFW5U3FEQM3NMGUFLYRNGCR2BC745KFXONFYQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.701354752 (728h16m21.613692383s) [noise=true , address=185.167.204.205:4026 , piece_id=36NVM6HXR7JLR757IVYPBSYKP66LEULBUVBC4MAIPTO4ALT56O6Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.701861078 (728h16m21.614198719s) [noise=true , address=185.167.204.206:4055 , piece_id=CTSEZDZRXMJUKPR57YLTIAQFWE3HP7UZ73TXDNBEG4MWJIGKIQ4Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.705015056 (728h16m21.617352687s) [noise=true , address=185.167.204.206:4045 , piece_id=TG6L7ZXTPHOVTPAQEQJXBWB2MEHGUCXF2VCIUX2FALLI24RMAVOQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.706794069 (728h16m21.6191317s) [noise=true , address=185.167.204.205:4027 , piece_id=YA6UKJC72EBNYPL2QDXAQBDUNACYW4S6EWBKCOS232M6C7P2QKQQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.709137933 (728h16m21.621475564s) [noise=true , address=185.167.204.205:4031 , piece_id=CK4CLDSFNKJ266AVYAJXCG56RCXI25Y3FNFQ7BYVLF2PZRIATTIQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.709326547 (728h16m21.621664178s) [noise=true , address=185.167.204.205:4022 , piece_id=JAGMS6IHPV4ONFJ6TMOY3CLYHL223IRKWINGUZCGYCMIY3EFZDZA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:22:09.055428021 (728h16m51.967765652s) [noise=true , address=89.149.201.147:4004 , piece_id=IY62XCARW7RHMQTAC2AGLTTWNSUF7ZBFUGD2GZO4Z5KGIUGE52BA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:22:35.885028773 (728h17m18.797366414s) [noise=true , address=89.149.201.147:4024 , piece_id=EKEMN2ZZE2ATB5TPJBT5VOEHOKE5ODLZNR4I7NWJLXS6LNMMCNFA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:22:36.816979956 (728h17m19.729317587s) [noise=true , address=81.171.14.70:4033 , piece_id=IJZAGM7IKIG5RCJMRSHKTGJC5PD2WVRDKFGADKLLTZEN2O4AFYZQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:54498->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:54498->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54498->81.171.14.70:4033: use of closed network connection Apr 5 19:22:36.817021095 (728h17m19.729358716s) [noise=true , address=89.149.201.147:4023 , piece_id=MV4WJFTMDW3DQG276URSOOTSSBJH4QYNQ2AFJWFYK4MG6E2GN4FA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:22:36.817079016 (728h17m19.729416648s) [noise=true , address=81.171.14.70:4030 , piece_id=F3JJBNLYHSYT3ICGZIYJRRQVB357C5G4LGPXMEK2PM5WD4NC2LSA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:54592->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:54592->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54592->81.171.14.70:4030: use of closed network connection Apr 5 19:22:36.817231311 (728h17m19.729568942s) [noise=true , address=81.171.14.70:4042 , piece_id=EIXY73TT6XZYTP7ICBEJ5O3VXC7G56TFGFUYISCORPZEXM5NWA3Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:60966->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:60966->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60966->81.171.14.70:4042: use of closed network connection Apr 5 19:22:36.817363456 (728h17m19.729701087s) [noise=true , address=89.149.201.147:4017 , piece_id=CO5SAWRDXNUBVJXVTKTX3GCBFVQK26AT2BIPW7CASX2B3PZRJC2A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:57876->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:57876->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57876->89.149.201.147:4017: use of closed network connection Apr 5 19:22:36.817485832 (728h17m19.729823463s) [noise=true , address=81.171.14.70:4031 , piece_id=BO4BH2KVUIZIO5HENQNCLHP3N766QNXIYHNMV5RXS74YBV4DC2QQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:22:36.817570044 (728h17m19.729907685s) [noise=true , address=81.171.14.70:4026 , piece_id=6OTRH3OM7UM3UHT7MYFG62U2MFTTVFF5SQ6KJNLFYV6MPUWIJOIA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:43384->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:43384->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43384->81.171.14.70:4026: use of closed network connection Apr 5 19:22:36.817628236 (728h17m19.729965868s) [noise=true , address=81.171.14.70:4041 , piece_id=EJJQUFKZX7PTHR7EV3Z324X7FH4D2M5NJ7LXYIUQLHNGZAWSDTAA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:42206->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:22:36.817646993 (728h17m19.729984624s) [noise=true , address=89.149.201.147:4009 , piece_id=LZ3F4APV5CHY5PXBS22TEQ5FD6QUZ7AMHJXDA3UJ2UJYTYDQSXQA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: write tcp 188.166.225.170:53086->89.149.201.147:4009: use of closed network connection; write tcp 188.166.225.170:53086->89.149.201.147:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53086->89.149.201.147:4009: use of closed network connection Apr 5 19:22:36.817668695 (728h17m19.730006326s) [seg_pos={0 0}, upload=698863]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Apr 5 19:22:36.985418462 (728h17m19.897756083s) [upload=698863]: Done uploading segments... Apr 5 19:22:36.985449411 (728h17m19.897787032s) [upload=698863]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 4.17189946s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.170484806s trace: https://jaeger.dev.storj.io/trace/59f818d5713f8a13 FAIL (2026-04-05 19:22:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== :21:37.498494987 (728h16m20.410832628s) [noise=true , address=185.167.204.205:4010 , piece_id=GECSCX24DVYUJDRNFW5U3FEQM3NMGUFLYRNGCR2BC745KFXONFYQ, seg_pos={0 0}, upload=698863]: Uploading piece... Apr 5 19:21:38.287074633 (728h16m21.199412264s) [upload=698863]: Next returned nil segment Apr 5 19:21:38.287089301 (728h16m21.199426922s) [upload=698863]: Waiting for error group managing segments... Apr 5 19:21:38.667740817 (728h16m21.580078458s) [noise=true , address=185.167.204.205:4008 , piece_id=PH3TL2YHM7K6CVQDHZFHECMY4QSHWJCF3KDKSJWMTUYONUNCWP4Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.671155557 (728h16m21.583493188s) [noise=true , address=185.167.204.205:4014 , piece_id=HABYZFBFKIXRMRPE7LIUGBRRO2ODUGXO72CWCNVMRHPPOPZDMPNQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.678777597 (728h16m21.591115228s) [noise=true , address=185.167.204.206:4069 , piece_id=CMDVU44LRTBCYO4RCZPQIR3IJT7IHDDXRZA44VHKYZITSV5PAJTA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.687073288 (728h16m21.599410919s) [noise=true , address=185.167.204.206:4071 , piece_id=XWUJZHSDBOVAMBOHJ76UNIYDEYFZSWD4IQCXJ5I66P6XRFPHAF6Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.689769191 (728h16m21.602106822s) [noise=true , address=185.167.204.206:4044 , piece_id=SR576JELJVLHID5UJKBN42ZXWK3CDOVA67PFYBSJNE25OXAYWL7A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.692924742 (728h16m21.605262373s) [noise=true , address=185.167.204.206:4072 , piece_id=7YNMSVBIM5EIF5Z52Q2O7VRKAQJAZ2GMDZPWQ45ZFEEVOKE7YWLA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.694064211 (728h16m21.606401842s) [noise=true , address=185.167.204.206:4058 , piece_id=KEXK3ME2VECOP6C5B5OMCHD2V45ZGQB67F4QEGSPHZHLSOVGHSMA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.697829938 (728h16m21.610167569s) [noise=true , address=185.167.204.205:4029 , piece_id=RUNVBCA6FSTQ7G2FOIQKI2FUAFMWMNHIDDF5KMY2EJB7U2JCAGIA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.698200975 (728h16m21.610538606s) [noise=true , address=185.167.204.206:4037 , piece_id=LOP2TWLKUIGHRF5BOJTSP33J2GNFUZTQ34Z7FPNCC2K254V6CU6A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.700560438 (728h16m21.612898069s) [noise=true , address=185.167.204.205:4019 , piece_id=2G5DVHGFZYKINUGPYM33S3MTZSAJLSTWFSMMFPCGWHJAFPJKYP6A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.701187339 (728h16m21.61352499s) [noise=true , address=185.167.204.205:4010 , piece_id=GECSCX24DVYUJDRNFW5U3FEQM3NMGUFLYRNGCR2BC745KFXONFYQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.701354752 (728h16m21.613692383s) [noise=true , address=185.167.204.205:4026 , piece_id=36NVM6HXR7JLR757IVYPBSYKP66LEULBUVBC4MAIPTO4ALT56O6Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.701861078 (728h16m21.614198719s) [noise=true , address=185.167.204.206:4055 , piece_id=CTSEZDZRXMJUKPR57YLTIAQFWE3HP7UZ73TXDNBEG4MWJIGKIQ4Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.705015056 (728h16m21.617352687s) [noise=true , address=185.167.204.206:4045 , piece_id=TG6L7ZXTPHOVTPAQEQJXBWB2MEHGUCXF2VCIUX2FALLI24RMAVOQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.706794069 (728h16m21.6191317s) [noise=true , address=185.167.204.205:4027 , piece_id=YA6UKJC72EBNYPL2QDXAQBDUNACYW4S6EWBKCOS232M6C7P2QKQQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.709137933 (728h16m21.621475564s) [noise=true , address=185.167.204.205:4031 , piece_id=CK4CLDSFNKJ266AVYAJXCG56RCXI25Y3FNFQ7BYVLF2PZRIATTIQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:21:38.709326547 (728h16m21.621664178s) [noise=true , address=185.167.204.205:4022 , piece_id=JAGMS6IHPV4ONFJ6TMOY3CLYHL223IRKWINGUZCGYCMIY3EFZDZA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:22:09.055428021 (728h16m51.967765652s) [noise=true , address=89.149.201.147:4004 , piece_id=IY62XCARW7RHMQTAC2AGLTTWNSUF7ZBFUGD2GZO4Z5KGIUGE52BA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:22:35.885028773 (728h17m18.797366414s) [noise=true , address=89.149.201.147:4024 , piece_id=EKEMN2ZZE2ATB5TPJBT5VOEHOKE5ODLZNR4I7NWJLXS6LNMMCNFA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: <nil> Apr 5 19:22:36.816979956 (728h17m19.729317587s) [noise=true , address=81.171.14.70:4033 , piece_id=IJZAGM7IKIG5RCJMRSHKTGJC5PD2WVRDKFGADKLLTZEN2O4AFYZQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:54498->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:54498->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54498->81.171.14.70:4033: use of closed network connection Apr 5 19:22:36.817021095 (728h17m19.729358716s) [noise=true , address=89.149.201.147:4023 , piece_id=MV4WJFTMDW3DQG276URSOOTSSBJH4QYNQ2AFJWFYK4MG6E2GN4FA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:22:36.817079016 (728h17m19.729416648s) [noise=true , address=81.171.14.70:4030 , piece_id=F3JJBNLYHSYT3ICGZIYJRRQVB357C5G4LGPXMEK2PM5WD4NC2LSA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 188.166.225.170:54592->81.171.14.70:4030: use of closed network connection; write tcp 188.166.225.170:54592->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54592->81.171.14.70:4030: use of closed network connection Apr 5 19:22:36.817231311 (728h17m19.729568942s) [noise=true , address=81.171.14.70:4042 , piece_id=EIXY73TT6XZYTP7ICBEJ5O3VXC7G56TFGFUYISCORPZEXM5NWA3Q, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:60966->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:60966->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60966->81.171.14.70:4042: use of closed network connection Apr 5 19:22:36.817363456 (728h17m19.729701087s) [noise=true , address=89.149.201.147:4017 , piece_id=CO5SAWRDXNUBVJXVTKTX3GCBFVQK26AT2BIPW7CASX2B3PZRJC2A, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 188.166.225.170:57876->89.149.201.147:4017: use of closed network connection; write tcp 188.166.225.170:57876->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57876->89.149.201.147:4017: use of closed network connection Apr 5 19:22:36.817485832 (728h17m19.729823463s) [noise=true , address=81.171.14.70:4031 , piece_id=BO4BH2KVUIZIO5HENQNCLHP3N766QNXIYHNMV5RXS74YBV4DC2QQ, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 19:22:36.817570044 (728h17m19.729907685s) [noise=true , address=81.171.14.70:4026 , piece_id=6OTRH3OM7UM3UHT7MYFG62U2MFTTVFF5SQ6KJNLFYV6MPUWIJOIA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 188.166.225.170:43384->81.171.14.70:4026: use of closed network connection; write tcp 188.166.225.170:43384->81.171.14.70:4026: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43384->81.171.14.70:4026: use of closed network connection Apr 5 19:22:36.817628236 (728h17m19.729965868s) [noise=true , address=81.171.14.70:4041 , piece_id=EJJQUFKZX7PTHR7EV3Z324X7FH4D2M5NJ7LXYIUQLHNGZAWSDTAA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:42206->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 19:22:36.817646993 (728h17m19.729984624s) [noise=true , address=89.149.201.147:4009 , piece_id=LZ3F4APV5CHY5PXBS22TEQ5FD6QUZ7AMHJXDA3UJ2UJYTYDQSXQA, seg_pos={0 0}, upload=698863]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: write tcp 188.166.225.170:53086->89.149.201.147:4009: use of closed network connection; write tcp 188.166.225.170:53086->89.149.201.147:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53086->89.149.201.147:4009: use of closed network connection Apr 5 19:22:36.817668695 (728h17m19.730006326s) [seg_pos={0 0}, upload=698863]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Apr 5 19:22:36.985418462 (728h17m19.897756083s) [upload=698863]: Done uploading segments... Apr 5 19:22:36.985449411 (728h17m19.897787032s) [upload=698863]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 1m0.17050257s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.29344798s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:16:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.293472255s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.570618446s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:15:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.570653334s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.690976339s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:14:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.69100229s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.342784662s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:14:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.342811413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.754700681s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:14:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.754734216s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.315335057s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:13:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.315360495s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.744061738s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:13:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.744095474s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.760059834s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:12:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.760085202s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.440359404s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:12:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.440391276s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.772989189s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:12:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.773013454s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.38370137s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:11:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.383729845s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.724379915s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:11:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.724409922s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.736354284s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:10:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.736383148s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.247531932s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:10:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.247558573s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.206388289s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:10:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.206416833s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.776823665s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:09:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.776849496s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.483121002s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:09:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.483185796s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.847459008s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:09:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.847487823s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.312857175s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:08:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.312887935s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.943891864s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:08:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.943919097s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.216885338s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:07:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.216910616s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.49175823s trace: https://jaeger.dev.storj.io/trace/4c7df959bc369e5d FAIL (2026-04-05 11:06:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 673s) [seg_pos={0 0}, upload=690369]: Done begin upload segment. Apr 5 10:28:08.593935972 (719h22m51.506273603s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.593949238 (719h22m51.506286879s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594385870 (719h22m51.506723512s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594397313 (719h22m51.506734954s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594688734 (719h22m51.507026366s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594730776 (719h22m51.507068407s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.594956221 (719h22m51.507293852s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595237504 (719h22m51.507575135s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595313561 (719h22m51.507651192s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595551561 (719h22m51.507889202s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.595617788 (719h22m51.507955419s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596433032 (719h22m51.508770663s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.596878090 (719h22m51.509215731s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.597725636 (719h22m51.510063267s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.598574223 (719h22m51.510911854s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599313451 (719h22m51.511651092s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.599679778 (719h22m51.512017409s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:08.600374478 (719h22m51.51271211s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Uploading piece... Apr 5 10:28:09.940724342 (719h22m52.853061983s) [upload=690369]: Next returned nil segment Apr 5 10:28:09.940780801 (719h22m52.853118432s) [upload=690369]: Waiting for error group managing segments... Apr 5 10:28:10.334846027 (719h22m53.247183658s) [noise=true , address=167.17.72.71:4794 , piece_id=A22N4MLDEBLAXB7E457NJWS7EMTYMCSOLEVIQT6OHLOTUZBOBWRA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.388987055 (719h22m53.301324686s) [noise=true , address=167.17.72.69:4734 , piece_id=HGE5ZTIFCUZZMRQ52GJMGD5RETX2Y7EBGFXKOHPTREXHA6K4ZQJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.392271775 (719h22m53.304609406s) [noise=true , address=193.149.164.68:4043 , piece_id=3BMTXRTKHDMAJID56LW355ZAW22KGRO5FE3WQY7SR7DBD6QGQHOQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.410788310 (719h22m53.323125951s) [noise=true , address=193.149.164.143:4703 , piece_id=XXBAVBUSNRAFEUQX5EAHNTC43QXYONCRVFTKZDVJ7JZFCQWNTYXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.422920936 (719h22m53.335258567s) [noise=true , address=193.149.164.69:4096 , piece_id=YECLPL5D3DMFSRM33DPUITK25GWIL3YBGZ7HTFPPWUU2OFN67P6Q, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.438753100 (719h22m53.351090731s) [noise=true , address=193.149.164.66:4991 , piece_id=XYBDSWIAPPLIB4JV4MGOHZHBOXT4BSZNULH3XJECM2XB5B3LFLJQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.466100228 (719h22m53.378437859s) [noise=true , address=193.149.164.71:4291 , piece_id=CUQVGDAAIGHVEGEWISAP5DBXPR6OFY2EUABMYNXGI4HSGG56UVPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.480587597 (719h22m53.392925239s) [noise=true , address=45.91.116.12:4238 , piece_id=HY5ZCY7GBKAKF2R4J275H76WAQT4PX2LEOJAPGJD3G7N5DM4G7FA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.528165128 (719h22m53.440502769s) [noise=true , address=193.149.164.67:4997 , piece_id=YCASEB63XDUV2HHGRP35C5S5QTRZ33IBJNBE3TJHO3KZ6BBBRMYQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.559681773 (719h22m53.472019415s) [noise=true , address=77.90.31.12:4610 , piece_id=AFZB2DBTL64Q5ZSS3D44MMDUGHNR3QLIRLYRU6BWEAN7O2M6TGPQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.564440517 (719h22m53.476778148s) [noise=true , address=77.90.31.18:4817 , piece_id=JL7G2CQJNJFQ5VYLBJDHY4TED5NCD7RTBZROBBFUOM6HE2HVQTZQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:10.568254798 (719h22m53.480592439s) [noise=true , address=77.90.31.17:4781 , piece_id=Q55ALJQVVAVU6TFUINQURPPFQN6VDC67ZHCJKLFRRRLB6MIBFR5A, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:28:25.855767800 (719h23m8.768105421s) [noise=true , address=145.79.227.13:4836 , piece_id=QOCCR3OEZ34RQ74U6FBAGOGAB6XJAMGWIAFSBKBMYSIGJQ33UFDQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: <nil> Apr 5 10:29:07.700074174 (719h23m50.612411805s) [noise=true , address=145.79.227.34:4926 , piece_id=R53DLWHX6HDFC76CWLWVNCXC2GNJFKWIV3Z4SSZGFZJR3BR7VDNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1LkGN9UdiF163eg78WUPpXqz4FxHBxhnPin4okcdU1YPDWx4MF, address:145.79.227.34:4926): protocol: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54598->145.79.227.34:4926: use of closed network connection Apr 5 10:29:07.700436523 (719h23m50.612774154s) [noise=true , address=64.49.13.169:4706 , piece_id=L5JPIJQOS2B7HOT5E777O4P3VSYBF6KF6FOMT2AJ5VU32W4GLGXQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7, address:64.49.13.169:4706): protocol: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56176->64.49.13.169:4706: use of closed network connection Apr 5 10:29:07.700604889 (719h23m50.61294253s) [noise=true , address=145.79.227.19:4087 , piece_id=TTCMPBSPQODYJ3UL4GSWOD6E2LNVTIAXIV5S7XGDYOGJYGB2SDLA, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1S9k5eejJcxkiG5pXjjBZm18uP8k5jCGfWyeW2QQxmuRU8ZzRA, address:145.79.227.19:4087): protocol: expected piece hash; context deadline exceeded; EOF Apr 5 10:29:07.701022564 (719h23m50.613360205s) [noise=true , address=145.79.227.11:4736 , piece_id=NIPFCM35EA2IE7MLHGBVTH6V2ZA2U4APT7PZFNBO2VDPBFGNUBNQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51376->145.79.227.11:4736: use of closed network connection Apr 5 10:29:07.701260553 (719h23m50.613598194s) [noise=true , address=64.49.13.139:4480 , piece_id=2AUZAY45DUAWIGAQWSNX6XKDSHQWHFQNEPJZSI4KEBWBGI5GFPIQ, seg_pos={0 0}, upload=690369]: Done uploading piece. err: ecclient: upload failed (node:12qN4pwQ12oQxGpHgDuoFuutMUQMuLnic9syqZFsE3SKr6ZoEfT, address:64.49.13.139:4480): protocol: read tcp 188.166.225.170:50388->64.49.13.139:4480: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:07.701290692 (719h23m50.613628323s) [seg_pos={0 0}, upload=690369]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 5 10:29:07.940175502 (719h23m50.852513133s) [upload=690369]: Done uploading segments... Apr 5 10:29:07.940208335 (719h23m50.852545966s) [upload=690369]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.49178393s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.896014654s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:06:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.896040664s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.774454355s trace: https://jaeger.dev.storj.io/trace/5f23406c8de425aa FAIL (2026-04-05 11:06:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== 28:41.758966513 (719h23m24.671304144s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759267184 (719h23m24.671604815s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.759550080 (719h23m24.671887711s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.760717443 (719h23m24.673055074s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.761764013 (719h23m24.674101644s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.762960341 (719h23m24.675297972s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.763418997 (719h23m24.675756638s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.764429707 (719h23m24.676767348s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.765511835 (719h23m24.677849467s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.766581169 (719h23m24.6789188s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:41.767045916 (719h23m24.679383548s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Uploading piece... Apr 5 10:28:43.526912859 (719h23m26.43925049s) [upload=690375]: Next returned nil segment Apr 5 10:28:43.526933919 (719h23m26.43927156s) [upload=690375]: Waiting for error group managing segments... Apr 5 10:28:43.865844872 (719h23m26.778182503s) [noise=true , address=77.90.31.14:4662 , piece_id=C35343F6RHNQMFM6GNZSE4MPEHNWFJV4SDTAWSPLEG3AXQMCXQMA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.871275142 (719h23m26.783612773s) [noise=true , address=77.90.31.21:4878 , piece_id=VLLQV5I4SPXGDW4Z6RA2VQ77YGWR4YN6GX5SDYXFSOKU7LUPDJFQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.873556334 (719h23m26.785893965s) [noise=true , address=77.90.31.19:4842 , piece_id=VXTVHHUTRZGUOIKTCAFLWMH6GXJLCEHGJDYB2J45GBLUBDOSMZLA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.874842286 (719h23m26.787179928s) [noise=true , address=77.90.31.10:4521 , piece_id=DP6THRI5UQQBXRRJKVJWVN3VIXCVLQHJ3R44SQFV5BK57GHGHENA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:28:43.877507860 (719h23m26.789845492s) [noise=true , address=45.91.116.8:4048 , piece_id=3ZSQVGEN7FBLJY77QYFGMQXEU5346C5CI5AMDASKALATC3ZZ2MDQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: <nil> Apr 5 10:29:10.872997255 (719h23m53.785334896s) [noise=true , address=145.79.227.34:4910 , piece_id=IK33TSOAXL4I4YUDAXS6FUTQNX5QXXH65E4LYZU3UJHOP34VXTSQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ, address:145.79.227.34:4910): protocol: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59300->145.79.227.34:4910: use of closed network connection Apr 5 10:29:10.873130363 (719h23m53.785468004s) [noise=true , address=145.79.227.52:4446 , piece_id=77Z7QQBRTHLP57D5EJVR5HBTC5SZ4P3T47JDZLJADVJ6OV2WSH2A, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:145.79.227.52:4446): protocol: read tcp 188.166.225.170:43724->145.79.227.52:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873193304 (719h23m53.785530935s) [noise=true , address=145.79.227.5:4227 , piece_id=H4WDLSYCJWA232GA77TDL5JT5XOPPP7NCX5HTMPVPW4YXWR64BQQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12nwrhLqAKoDy7KkoPsgCAy44m7T1JcEqbgatNYXThZ7sGc84vA, address:145.79.227.5:4227): protocol: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34256->145.79.227.5:4227: use of closed network connection Apr 5 10:29:10.873269541 (719h23m53.785607172s) [noise=true , address=145.79.227.38:4980 , piece_id=XSVBJZV5AKEF3M62LGISDLBRR6JPXMFW7DYGID46YAWSL74EIBGA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1hzDqFsTcWDF5LLW9tm77hLADjUkhbLqkE3DBSHyJf3PyiHszu, address:145.79.227.38:4980): protocol: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33856->145.79.227.38:4980: use of closed network connection Apr 5 10:29:10.873376307 (719h23m53.785713938s) [noise=true , address=145.79.227.15:4873 , piece_id=FD6KPQYJUTWW5CJ5LM7VAVPAGIMN2JGR2CRPFHVG4TSYHRLSSWHA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: read tcp 188.166.225.170:60226->145.79.227.15:4873: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873463886 (719h23m53.785801517s) [noise=true , address=145.79.227.49:4338 , piece_id=DJ4ZNILUUDLVUL4UCJGGEMSSLQJ2WH2F3QKLTTTW6EW7PPWNNHRA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN, address:145.79.227.49:4338): protocol: read tcp 188.166.225.170:37050->145.79.227.49:4338: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873545043 (719h23m53.785882674s) [noise=true , address=145.79.227.26:4655 , piece_id=GZQF772HVQPBHPGENON5UQOGLVZWI42DP4G3GZ6R2UIWRBEFSKUA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: read tcp 188.166.225.170:43040->145.79.227.26:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.873620678 (719h23m53.785958309s) [noise=true , address=145.79.227.45:4232 , piece_id=N6YQQUNR3HC73EQVT76P3PKCMMBDNRZ6TACULESTLHB7YUVNSQPQ, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56608->145.79.227.45:4232: use of closed network connection Apr 5 10:29:10.873692026 (719h23m53.786029657s) [noise=true , address=145.79.227.31:4801 , piece_id=WUBRZAEM4XGQCILZCTM33JHNGWHVR5INQ3W6UI4M466XKC6VUINA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12pdMen2HsTBypaNt4cUu12TWjhbKnk3V287JJus1273x28xDXM, address:145.79.227.31:4801): protocol: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56190->145.79.227.31:4801: use of closed network connection Apr 5 10:29:10.873782761 (719h23m53.786120392s) [noise=true , address=145.79.227.28:4730 , piece_id=BQ5BKEMCOG45UCUEWFG4INBSDJKRQQMS2M6CFSNKDKIIJVEMNP6Q, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:1SXQt5FugmWj1YdhsvaaR7bDoxTBkqHKZpyXSmQqGdX5ZRhKxV, address:145.79.227.28:4730): protocol: read tcp 188.166.225.170:46524->145.79.227.28:4730: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874019218 (719h23m53.786356849s) [noise=true , address=145.79.227.10:4404 , piece_id=PI3OI5Q5BRFD65SAV3OH3B7EERSN46OFSXLAV6GZX55HYXYPBOZA, seg_pos={0 0}, upload=690375]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: read tcp 188.166.225.170:38076->145.79.227.10:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 5 10:29:10.874041300 (719h23m53.786378931s) [seg_pos={0 0}, upload=690375]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Apr 5 10:29:11.101342434 (719h23m54.013680075s) [upload=690375]: Done uploading segments... Apr 5 10:29:11.101383785 (719h23m54.013721416s) [upload=690375]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.774481317s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)