Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 4.945478519s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:44:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.945555035s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.830330995s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:44:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.830363547s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 4.930305802s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:43:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.930335188s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.849079554s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:42:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.84910925s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.269878725s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:41:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.269924924s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 9.660933602s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:40:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 9.66095889s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.221532174s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:39:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.221559997s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 4.851661614s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:38:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.851693183s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.264446968s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:38:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.264479619s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.895105675s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:37:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.895133768s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.984085842s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:37:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.984114428s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.837578664s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:36:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.83761298s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 35.305640083s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:36:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 35.305665902s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.271078409s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:34:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.271102837s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.824229319s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:33:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.824260418s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.863564925s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:32:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.863596175s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 4.928155062s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:31:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.928199988s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 4.908454972s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:31:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.90849068s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.867513813s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:30:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.86754429s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.946393278s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:29:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.946421672s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.299006636s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:28:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.29903509s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.217444828s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:28:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.217497879s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 4.849552555s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:27:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.849585419s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 4.887346618s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:25:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.887376795s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.947315011s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:25:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.947343085s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 4.904927899s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:24:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.904961013s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 4.863619677s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:23:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.863648213s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 4.887626743s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:23:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.887643004s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 4.905954746s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:22:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.905987679s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.310349628s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:21:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.310428207s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 4.95891941s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:20:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.95894116s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.310535905s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:20:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 5.310564249s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.916079373s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:19:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 4.916099301s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.178056568s trace: https://jaeger.dev.storj.io/trace/35277bbd5e762628 FAIL (2025-11-12 21:19:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 21) ======LOGS====== HCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913076652 (85h14m3.464547103s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913219484 (85h14m3.464689945s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913553971 (85h14m3.465024442s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.913680362 (85h14m3.465150823s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.914392788 (85h14m3.465863249s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.915398704 (85h14m3.466869165s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916000619 (85h14m3.46747108s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:04.916773050 (85h14m3.468243511s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Uploading piece... Nov 12 21:18:06.157161053 (85h14m4.708631515s) [upload=75031]: Next returned nil segment Nov 12 21:18:06.157178346 (85h14m4.708648807s) [upload=75031]: Waiting for error group managing segments... Nov 12 21:18:06.728386598 (85h14m5.279857069s) [noise=true , address=89.149.201.147:4014 , piece_id=3VEOEST54FJUOAI4H43LTDL5NND2CZR2F3I6XNY24R4XRG6VMXUA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.754778644 (85h14m5.306249095s) [noise=true , address=89.149.201.147:4008 , piece_id=MUVRY6DEYI3NUOC7M5DC3QLWWIWMD2KBTNTDOGJLBL4AT2IOFDCA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.838808706 (85h14m5.390279167s) [noise=true , address=89.149.201.147:4009 , piece_id=HNSHS5P3ZAJJ6M3EBACAFGXTY6XHEDPQOJ5OB452ZJZN6MHAQZZA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.857974922 (85h14m5.409445383s) [noise=true , address=185.167.204.206:4052 , piece_id=NFCMVYG6TYTPVXUPNOCELC7UTH4EAZLBDSE2EDBBXM753OQXBO5A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.889327694 (85h14m5.440798145s) [noise=true , address=185.167.204.206:4067 , piece_id=BKRDBERVAQSM2MSHCLWJXXFXYAT23Q3FTJLADKNHSASQ7NX5XVEA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.976342589 (85h14m5.52781305s) [noise=true , address=185.167.204.206:4047 , piece_id=CTA2WMP4THC27WLISKTJO36LK2A4INJMDLRZ226YGAYABXEX4OTQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:06.982871261 (85h14m5.534341722s) [noise=true , address=185.167.204.206:4041 , piece_id=OJYHXGFIF4EDGMQTEXVBPZGHQK6MLOIGXWUTZDZESUGWZLN4QLVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:07.308875213 (85h14m5.860345674s) [noise=true , address=89.149.201.147:4017 , piece_id=CIRR7OC5L4HDTR3M6NRDEML4W37YL7Z7ISUCPNLVNKQRZ63MP4VQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:09.365852749 (85h14m7.91732321s) [noise=true , address=185.167.204.206:4056 , piece_id=6J5IBQYGCPUU2G4OCHAH4HCZ2SS5F2IXUVB7D7K6O7B43NRCPRRA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.361331969 (85h14m9.91280242s) [noise=true , address=185.167.204.205:4034 , piece_id=CJE774WAFZIKVKUISYR2Z4XZ72RKYN7TCMIYKTQ52ROFC6ZQLY6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:11.445478893 (85h14m9.996949364s) [noise=true , address=185.167.204.206:4058 , piece_id=HQGURVXQR5OK4LZP4PPTPCGQV63LJPIJREWCZHM3PBKPIL52X66A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.626137808 (85h14m13.177608269s) [noise=true , address=185.167.204.205:4026 , piece_id=F7WKA5PJVI5EDDPRYWDGR22FV2K2EWVAO6SVGJZ2STVUN4665ZPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:14.918627492 (85h14m13.470097953s) [noise=true , address=185.167.204.206:4061 , piece_id=M6BO2A6TMKVYRKGGGGLXMT26KTX2KPZVS6PS7UCKCV2T3C3PVTLQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:15.761879704 (85h14m14.313350165s) [noise=true , address=185.167.204.205:4004 , piece_id=MURR2A6CI5CKHETCB5DHM5WO6M2DGMXJ4X6QR3QHOVAMSJV7EM6A, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:19.194472473 (85h14m17.745942924s) [noise=true , address=185.167.204.205:4019 , piece_id=BVQHBG6GFWBJJCYHIWSGARWVPNFBZNZBH426Q4ABJJGW7EOI4SFA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:25.107506786 (85h14m23.658977247s) [noise=true , address=185.167.204.206:4059 , piece_id=UJ4LPRT7MY335FVXYLJ3HEVYLYAGGSJNRELORJNYRDGTJLIPLHGQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:28.357762493 (85h14m26.909232954s) [noise=true , address=185.167.204.205:4001 , piece_id=7RDX753ZZKZU7JD4NGNLWSUC3YPSLADTWMJDBP7EZFLYI44WJMEQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:29.982045925 (85h14m28.533516386s) [noise=true , address=185.167.204.205:4007 , piece_id=DZXFJ3DIF3OB4ETT6H665RSNP6337F5MPNLNHZI2AHIGVSALD5HQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:35.394743986 (85h14m33.946214437s) [noise=true , address=185.167.204.205:4008 , piece_id=PZ7TNRTGYR7MGZD26S737YQHJGEJK3FUBBMGVYLRKFYAP4HNFWPQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:36.203949025 (85h14m34.755419486s) [noise=true , address=185.167.204.205:4018 , piece_id=VSWVT2HBMX4S2JDPGZJDK4XW3MVZP5KWSBH6IBPPT474YC75FVPA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:18:44.547141713 (85h14m43.098612174s) [noise=true , address=185.167.204.205:4033 , piece_id=BRPAWOZHR5HDCOLPTSEHDZDLDRO5JCPHQ737WQ4VER2UURQ4MTQQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: <nil> Nov 12 21:19:04.249380232 (85h15m2.800850714s) [noise=true , address=81.171.14.70:4040 , piece_id=ZVMJ7J7CUZAVZS6VLYSRWFXAUKAISAKUOJKSD37CLZFUB3SPF6WA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249401533 (85h15m2.800871984s) [noise=true , address=81.171.14.70:4042 , piece_id=SY7OYEH3FEBYJGMM3VDQWGIPXHRUZ3NX3XUQVDKFEAVFHYLNVRVQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46350->81.171.14.70:4042: use of closed network connection Nov 12 21:19:04.249561848 (85h15m2.801032319s) [noise=true , address=81.171.14.70:4027 , piece_id=4PMQEWPWU4CAS7BSIB26IPLY6BBSJDPH6S3VVJU6TV5RJLSZHBSA, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249669633 (85h15m2.801140104s) [noise=true , address=81.171.14.70:4046 , piece_id=VFQA7J7UWR2UWHY33LYRG5FRKZXMHFVNYIPSX6UZ7PB2N3NQDHUQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.249765386 (85h15m2.801235847s) [noise=true , address=81.171.14.70:4037 , piece_id=5K7Q33C36XNWLR4ZV2ROVLSFQ5GZI2LMLXS5BMBWTKLCSFQJN2ZQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 188.166.225.170:55632->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.249928907 (85h15m2.801399369s) [noise=true , address=81.171.14.70:4033 , piece_id=7GMBQCZERMO72IORQBDFCXLCI3RZDDOAA6EQG7AWOHTSC7IEPJKQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: expected piece hash; context deadline exceeded; EOF Nov 12 21:19:04.250384956 (85h15m2.801855417s) [noise=true , address=81.171.14.70:4034 , piece_id=JSV6VZQZX6S3NE2D3WHLZWDAMKJI6GWDL6KBUHJWHLSJSWVNXQIQ, seg_pos={0 0}, upload=75031]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: read tcp 188.166.225.170:35558->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 21:19:04.250439540 (85h15m2.801910001s) [seg_pos={0 0}, upload=75031]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil> Nov 12 21:19:04.424549413 (85h15m2.976019884s) [upload=75031]: Done uploading segments... Nov 12 21:19:04.424605970 (85h15m2.976076431s) [upload=75031]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21) Duration: 1m0.178084551s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.839630281s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:54:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.839683342s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 4.893112869s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:54:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.893145192s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 4.834394919s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:53:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.83442139s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.XXX........................................................] duration: 4.880502056s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:52:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.880531663s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration: 5.284254451s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:52:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 5.284281943s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...XXX......................................................] duration: 4.959985207s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:51:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.960010665s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration: 4.907413313s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:51:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.90744384s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration: 4.91666019s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:50:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.916683814s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [......XXX...................................................] duration: 4.887221031s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:49:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.887249074s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration: 4.995334672s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:49:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.99537557s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [........XXX.................................................] duration: 4.876005844s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:48:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.876032035s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.........XXX................................................] duration: 4.833068323s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:48:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.833159606s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..........XXX...............................................] duration: 4.928225334s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:47:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.928254049s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...........XXX..............................................] duration: 4.922447463s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:47:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.922484756s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [............XXX.............................................] duration: 4.832642742s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:46:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 4.832671196s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.............XXX............................................] duration: 5.259172316s trace: https://jaeger.dev.storj.io/trace/45bd9e2340ba34ac FAIL (2025-11-12 19:46:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== 7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:06.578920173 (83h7m5.130390634s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Uploading piece... Nov 12 19:11:07.839593682 (83h7m6.391064143s) [upload=73166]: Next returned nil segment Nov 12 19:11:07.839609292 (83h7m6.391079753s) [upload=73166]: Waiting for error group managing segments... Nov 12 19:11:08.407010437 (83h7m6.958480898s) [noise=true , address=185.167.204.205:4029 , piece_id=UIZC3MXQMVNDCKZJUPRKJZZFB3X4LPDZZMAV52OZU46QFQJKE5QA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.420417297 (83h7m6.971887758s) [noise=true , address=185.167.204.206:4060 , piece_id=EWPYOIFQ4SJKCW5YBNSOCT275DMPD2AX3VNZAWH4R4XAMGBTXZIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.421074849 (83h7m6.97254531s) [noise=true , address=185.167.204.206:4059 , piece_id=XIOMFA7CGVX222E6EUBI6FXZ3U7MARY7Z6KS5WYCNHH3FLFZ6BDQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.430081610 (83h7m6.981552071s) [noise=true , address=89.149.201.147:4001 , piece_id=YJMPTIK2K2QAW3IFKGNELC34UKHF6IKRWTMLKQOGYJ4UQDLHXJYQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.440139683 (83h7m6.991610134s) [noise=true , address=89.149.201.147:4009 , piece_id=5IFGQ4MRD3DMYB6T7MZMCO4H5OO5ORNEGT3NHKUO6GWFODFHW72A, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.446882252 (83h7m6.998352723s) [noise=true , address=89.149.201.147:4023 , piece_id=TQXKWXUTM67HXI3WVECCUP7LYNFCYTJWJSLB4C22QECJD7JATBJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.452158048 (83h7m7.003628509s) [noise=true , address=185.167.204.205:4023 , piece_id=LVJTWTPMRFGIHJSUKSHXDD7Y5M7LRT3RALKEWY3AWICDI4DWFUJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.455220790 (83h7m7.006691241s) [noise=true , address=89.149.201.147:4018 , piece_id=UZTDCCR437NYVJKXF4OE2HAWK254645GZLUWBJL3WG4QAATUOIZA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.461101409 (83h7m7.01257187s) [noise=true , address=185.167.204.206:4038 , piece_id=WZGDCB4HEIH25IHB5BKVQ47O7G4ROGPLRURT2F3VLFP5YHWY4XTA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.468258387 (83h7m7.019728848s) [noise=true , address=185.167.204.205:4003 , piece_id=ZGXXWXQ2TQJ3EUFUAIBYPJLICHUXEW4KORPUKZNCQFDYAWHCG6PA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.470585378 (83h7m7.02205583s) [noise=true , address=185.167.204.206:4050 , piece_id=UOCVSBIZLDW3ERLKRZFU5Q74MIOW7R3EAIDXNVW4I6REYICFXNOA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.473600199 (83h7m7.02507066s) [noise=true , address=89.149.201.147:4020 , piece_id=RPBWVH3T6QO2VM5QCT55UBR54I3T3G5FX4OLMXL5XLGSVWE4MFHA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.481643796 (83h7m7.033114257s) [noise=true , address=89.149.201.147:4005 , piece_id=G2EMQTB5RQXQE555YL2CY7AKZ6NESS3ICOIZHJS6FFIKGXDAYJ4Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.492150463 (83h7m7.043620924s) [noise=true , address=185.167.204.205:4009 , piece_id=ZHLVEKZTIIMINBGQWYDE3USJAGLMW45DNYLFW5HFIJUZKRCVP4UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.496844992 (83h7m7.048315443s) [noise=true , address=185.167.204.205:4011 , piece_id=FMQIJMV6ZMWICCDVFKXCCRFOSZOKM63OWUGHITONANIKYOM7J4IA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.502936351 (83h7m7.054406812s) [noise=true , address=185.167.204.205:4001 , piece_id=P6ZVMPNCSXN6HDXB75UJMARP4QFE7B5KAQOFYIMG4SLFRYVYGMJA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.506297802 (83h7m7.057768263s) [noise=true , address=185.167.204.205:4015 , piece_id=K5O7PVBSBZSH73AB6CXRK36OUGZHKVASJ6FVEX4KLMOE3XQSGONQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.513261863 (83h7m7.064732324s) [noise=true , address=89.149.201.147:4010 , piece_id=MVC4WF3IBUQQGRVIFJYAPDV5HY3EWFYQLLMV7YPDTQ3VM5DQNUXQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.521414257 (83h7m7.072884718s) [noise=true , address=89.149.201.147:4016 , piece_id=U7WDPLCA2KFPNAFTZVI6VRA32BR4SALBZKTA3I5ZTDC3ROP6UFMA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:11:08.566177936 (83h7m7.117648397s) [noise=true , address=185.167.204.205:4020 , piece_id=PIKSGY7MSEYSMYMQO7D32DKHKYED5KAMUE3VOJG5IUUHA5BHOG2Q, seg_pos={0 0}, upload=73166]: Done uploading piece. err: <nil> Nov 12 19:12:05.878997613 (83h8m4.430468064s) [noise=true , address=81.171.14.70:4032 , piece_id=QKSKUPD4JHK7FCK2OYFBY2SHGD5X2452HW32XXGX5IP7MKPWATAA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41762->81.171.14.70:4032: use of closed network connection Nov 12 19:12:05.879230216 (83h8m4.430700677s) [noise=true , address=81.171.14.70:4033 , piece_id=UJNKIYWFZ2AFPCF6XND243VYNTEJ2WAHASLGWCF5LSCUSAT6ZQKA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51970->81.171.14.70:4033: use of closed network connection Nov 12 19:12:05.879559022 (83h8m4.431029483s) [noise=true , address=81.171.14.70:4029 , piece_id=UK4Q2AF5AWQOPYAIZSFCJVYNKPEFCIW74T45FQHVCRSQPARUZHBA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43980->81.171.14.70:4029: use of closed network connection Nov 12 19:12:05.879857471 (83h8m4.431327962s) [noise=true , address=81.171.14.70:4040 , piece_id=GJGAYFJCLOMV4M42SKLAHBZLEFCFP4WQ4HBI36VWRWOHSERMKXYA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:41536->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 12 19:12:05.879900713 (83h8m4.431371164s) [noise=true , address=81.171.14.70:4037 , piece_id=TVFZ27I67CYRXDIAVAIA2KYN5EQ75LHLAO42S7FB5HUKKBBDD7UA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60340->81.171.14.70:4037: use of closed network connection Nov 12 19:12:05.880009840 (83h8m4.431480301s) [noise=true , address=81.171.14.70:4041 , piece_id=VFXIWHVJI6PSSUD522IQGKVOEHRRCGJLGMXSUTDHZ2TRPWLHMFVA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33734->81.171.14.70:4041: use of closed network connection Nov 12 19:12:05.880095664 (83h8m4.431566115s) [noise=true , address=81.171.14.70:4035 , piece_id=KEMS4YFGLTJIOIUH4VPOYGNHIRBWGM5RRW63C2KNGMETVTGJFTIA, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47454->81.171.14.70:4035: use of closed network connection Nov 12 19:12:05.880219970 (83h8m4.431690432s) [noise=true , address=81.171.14.70:4046 , piece_id=VLXRG3KN3JFFGMRWDSMKWSOEOTW45T2FJX7E5PU6XGTU63M3XLJQ, seg_pos={0 0}, upload=73166]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34008->81.171.14.70:4046: use of closed network connection Nov 12 19:12:05.880265837 (83h8m4.431736299s) [seg_pos={0 0}, upload=73166]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Nov 12 19:12:06.052394579 (83h8m4.60386504s) [upload=73166]: Done uploading segments... Nov 12 19:12:06.052446328 (83h8m4.603916789s) [upload=73166]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 5.259205109s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)