Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.883410598s FAIL (2025-07-24 07:34:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.883438511s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 12.325804ms remote: "tcp:[2600:1417:3f:a86::1aca]:443" target: https://www.apple.com/robots.txt FAIL (2025-07-24 07:33:48 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 12.340071ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.586504679s FAIL (2025-07-24 07:33:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.586547242s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.609842366s FAIL (2025-07-24 07:32:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.609867573s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 12.177438ms remote: "tcp:[2600:1417:3f:a86::1aca]:443" target: https://www.apple.com/robots.txt FAIL (2025-07-24 07:32:55 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 12.200083ms core website
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2.012528289s remote: "tcp:[2600:1417:3f:a86::1aca]:443" target: https://www.apple.com/robots.txt FAIL (2025-07-24 07:32:18 UTC) orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error Duration: 2.012559649s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.78665236s FAIL (2025-07-24 07:31:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.786680785s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.825050623s FAIL (2025-07-24 07:31:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.825077984s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.763355516s FAIL (2025-07-24 07:30:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.763375886s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.851770903s FAIL (2025-07-24 07:30:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.851796431s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.729921534s FAIL (2025-07-24 07:29:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.729946563s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.771875902s FAIL (2025-07-24 07:28:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.771906953s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.709121457s FAIL (2025-07-24 07:28:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.709143559s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.836652908s FAIL (2025-07-24 07:27:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.836686212s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.620349988s FAIL (2025-07-24 07:26:10 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.620376659s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.767281451s FAIL (2025-07-24 07:25:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.767320224s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.831965062s FAIL (2025-07-24 07:25:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.831985551s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.778537043s FAIL (2025-07-24 07:24:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.778580706s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.571593197s FAIL (2025-07-24 07:23:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.571618826s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.022233034s FAIL (2025-07-24 07:22:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 6.022261168s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.64257936s FAIL (2025-07-24 07:22:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.642613927s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.704868327s FAIL (2025-07-24 07:21:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.704895768s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.614274149s FAIL (2025-07-24 07:20:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.614308204s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.783465864s FAIL (2025-07-24 07:19:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.7834851s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.553622855s FAIL (2025-07-24 07:18:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.553646842s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.176848234s FAIL (2025-07-24 07:17:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 6.176870027s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.925776936s FAIL (2025-07-24 07:17:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.925800931s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.627900194s FAIL (2025-07-24 07:15:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.627926735s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.876118047s FAIL (2025-07-24 07:15:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.876153605s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.780958558s FAIL (2025-07-24 07:14:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.780987265s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.795570714s FAIL (2025-07-24 07:13:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.795595903s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.561529295s FAIL (2025-07-24 07:12:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.56155891s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.618788899s FAIL (2025-07-24 07:11:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.618817194s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.668388942s FAIL (2025-07-24 07:10:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.66841366s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.816601384s FAIL (2025-07-24 07:09:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.816631573s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.683107664s FAIL (2025-07-24 07:09:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.68313654s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.58809589s FAIL (2025-07-24 07:08:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.58811604s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.885972567s FAIL (2025-07-24 07:07:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.885990741s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.550394094s FAIL (2025-07-24 07:07:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.550421606s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.802326881s FAIL (2025-07-24 07:05:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.802350667s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.635705749s FAIL (2025-07-24 07:05:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.635735747s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.674767538s FAIL (2025-07-24 07:04:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.674795813s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.962354841s FAIL (2025-07-24 07:03:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.96238105s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.730989239s FAIL (2025-07-24 07:03:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.731024736s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.881333248s FAIL (2025-07-24 07:03:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.881360681s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.83554388s FAIL (2025-07-24 07:02:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 5.835571233s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.476801017s FAIL (2025-07-24 07:02:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308641280 (128h11m11.681220635s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308712947 (128h11m11.681292302s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:05.308881359 (128h11m11.681460714s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Uploading piece... Jul 24 07:02:06.410103922 (128h11m12.782683277s) [upload=102479]: Next returned nil segment Jul 24 07:02:06.410123008 (128h11m12.782702363s) [upload=102479]: Waiting for error group managing segments... Jul 24 07:02:06.689288175 (128h11m13.06186753s) [noise=true , address=79.127.205.233:4643 , piece_id=LVLHTYBSZX6HPWPMZZKX3P2ZWK2WNFOOMK2TTJV6CEFCFF2JDYGA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: <nil> Jul 24 07:02:06.864100391 (128h11m13.236679746s) [noise=true , address=104.36.82.47:4538 , piece_id=FQ4V75VLOAWWPFQ7HMQIEX3XVGM6PQNNH22N2AIPERL4AE3SGZNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12P3N79R3vpvkpsJ4fEd6NcJtmMpszRW5KHgfYJvkHQzvSTf3i5, address:104.36.82.47:4538): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864165937 (128h11m13.236745302s) [noise=true , address=104.36.82.56:4259 , piece_id=LJPIOHTHZG6CXV6VYSI6D4F5OA2BR7QIKL4FLY4S5RCSMM7PLNDA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12BCJsPfe1NNUxVUfQWKbvkzviQWYgMxkRZjDhKJ7KFZc1GmnjV, address:104.36.82.56:4259): internal: context deadline exceeded Jul 24 07:02:06.864241090 (128h11m13.236820445s) [noise=true , address=77.90.31.10:4549 , piece_id=GRZ4TLSBMSR566TBSMEMMBZZ4GIYPHGZ643PJ3FGNGXQDI7MVHAA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1Uay43uEvzmHudZaGM1ZcEFbEdUXzQto5RtZNiQXgrqaRmuQoy, address:77.90.31.10:4549): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864404132 (128h11m13.236983487s) [noise=true , address=104.36.82.52:4114 , piece_id=KEH6ZSNMKNM6GYL5UEYO5HK4QWQUEZN4T46FPOOACIAAMBUJ7L3A, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12PXReFMGqAhCAp5BSE3vsJdfRAUathsJLdB8Guz7DzW6UHmATM, address:104.36.82.52:4114): protocol: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38286->104.36.82.52:4114: use of closed network connection Jul 24 07:02:06.864458316 (128h11m13.237037671s) [noise=true , address=77.90.31.12:4612 , piece_id=Z62XYSMYDZWR5E4FOKBVP6HUZT5EXYZTFWQUCICJPWBRWENSODVQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864470209 (128h11m13.237049574s) [noise=true , address=45.91.116.7:4040 , piece_id=3ZCBUE7ARKTFYQQDMT3PCNSVCIVME5QTEE242E3DORSMLILBNVNA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:126XVFQJR5dbxDwfCwsYFUh8XM7ossbNEdNR4LP9vNAb9Zz1k8g, address:45.91.116.7:4040): protocol: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37250->45.91.116.7:4040: use of closed network connection Jul 24 07:02:06.864534692 (128h11m13.237114047s) [noise=true , address=45.91.116.12:4233 , piece_id=I3O462JNBMVOCXTBFQLTARTCQMOH7OIW5GKUE4XVTC3PLTQYFSIA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12a6TZtzmwrv4y7V7LNfFfjAEYXdsztEwpS6fVZZTQVFihPnz5p, address:45.91.116.12:4233): protocol: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41176->45.91.116.12:4233: use of closed network connection Jul 24 07:02:06.864565210 (128h11m13.237144565s) [noise=true , address=77.90.31.15:4706 , piece_id=QZO5M7CHM5ZH7NAJW26CKAOBKRVIEOHENNBAXBPQPGUJQVURPKCQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12YZZnCo54XknuvoBoVtRudXSnoWdNdrn23Lp6Gou3g451BzUwG, address:77.90.31.15:4706): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864615076 (128h11m13.237194431s) [noise=true , address=104.36.82.10:4097 , piece_id=EVL3TSHZYOVNY3P54CSBLCPDPPBX55GSUUYWVYMQ2QI42QKOI4HQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12QP2aZ9BC22cD1Nzz2E12DiA1XoNu3GGTgHC8Cc3TvpQM3Ubn3, address:104.36.82.10:4097): protocol: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37620->104.36.82.10:4097: use of closed network connection Jul 24 07:02:06.864694438 (128h11m13.237273793s) [noise=true , address=79.127.220.98:4397 , piece_id=TG7NQ2LVBWCQBWG72GD562RODMEKYGXZEXDE43TYW3J2OEVYPBWA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1k1BvKmnpCHHArEGsEiG54cAsQnKZtGcZf1QMzEffPQWMqT3ac, address:79.127.220.98:4397): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864743742 (128h11m13.237323098s) [noise=true , address=104.36.82.54:4192 , piece_id=3UIOGPCU3VRRUUY6ADQSL2FUDNUA4KMFKFRUGDDW3LNXIEKYE6SA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12peSG85BzWEjq3FZ5xMqLE2gStDvy2dViRdYmDJz7Lq8yBfaKY, address:104.36.82.54:4192): protocol: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40512->104.36.82.54:4192: use of closed network connection Jul 24 07:02:06.864758871 (128h11m13.237338226s) [noise=true , address=79.127.219.48:4096 , piece_id=5FBGRH4CO7TGJ2QDTGESDZLIK5FQHBJC3XZ55AZ5NWUESKOUXQPQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12b1ofwZn7B7Qg72gSWmf9nnms2MZeGuUteBtLSYUpiyzZh4px5, address:79.127.219.48:4096): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.864839525 (128h11m13.23741888s) [noise=true , address=45.91.116.14:4223 , piece_id=ACFDHFOBPJ6C66NAKO2SX546WIXKX6T23PYZZJC3ALYQBAAVKDZA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:1f2MspBPykwYCWAYzJ9PCAXop6mPNarJt3fa6fWZoLipZZQdy1, address:45.91.116.14:4223): protocol: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35808->45.91.116.14:4223: use of closed network connection Jul 24 07:02:06.864915561 (128h11m13.237494916s) [noise=true , address=45.91.116.5:4303 , piece_id=725W4MZ6P3S5XE4IRSANJ45EJX64MJSZAY5T4STZN33CFZE2XRUA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12TN4WuuSUfxS3eTfp4bacgkTzJAdtUpcKAVM6Qiad5zEvzbjMY, address:45.91.116.5:4303): protocol: expected piece hash; context deadline exceeded; EOF Jul 24 07:02:06.865867643 (128h11m13.238446998s) [noise=true , address=45.91.116.8:4069 , piece_id=4WKBDX4QMWOTTDAFLAHKOLJNSBVWNTFFOZXHGKLR7G2TQYUIHW4Q, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:12m1yxZYJzQgSAf2URZjGvwASkD9WbzMSFJxNZQ1TobU7zUn7Tk, address:45.91.116.8:4069): protocol: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35682->45.91.116.8:4069: use of closed network connection Jul 24 07:02:06.865944108 (128h11m13.238523464s) [noise=true , address=104.36.82.11:4144 , piece_id=36SWY7VDPZSZNLQQRCWKYDR4M4ZFFXA3N7RJAI2HNG5F6WKXQIFA, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235, address:104.36.82.11:4144): protocol: write tcp 188.166.225.170:50508->104.36.82.11:4144: use of closed network connection; context deadline exceeded Jul 24 07:02:06.865978755 (128h11m13.238558111s) [noise=true , address=45.91.116.8:4066 , piece_id=76EMY74SLVKIZFWR2WZXQZMKEMJ5IOTS5J5P2EFOQEOTREDFBAOQ, seg_pos={0 0}, upload=102479]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47374->45.91.116.8:4066: use of closed network connection Jul 24 07:02:06.865995797 (128h11m13.238575153s) [seg_pos={0 0}, upload=102479]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Jul 24 07:02:07.339745882 (128h11m13.712325257s) [upload=102479]: Done uploading segments... Jul 24 07:02:07.339781901 (128h11m13.712361256s) [upload=102479]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 1m0.476820335s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.63122918s FAIL (2025-07-24 04:33:39 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=99870]: Starting upload Jul 24 03:46:34.240675379 (124h55m40.613254734s) [upload=99870]: Done starting upload Jul 24 03:46:34.240780020 (124h55m40.613359375s) [upload=99870]: Uploading segments... Jul 24 03:46:34.240872236 (124h55m40.613451591s) [upload=99870]: Got next segment. Inline: false Jul 24 03:46:34.240909317 (124h55m40.613488672s) [upload=99870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 03:46:34.240914497 (124h55m40.613493852s) [upload=99870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 03:46:34.690348981 (124h55m41.062928336s) [seg_pos={0 0}, upload=99870]: Begin upload segment... Jul 24 03:46:34.690393707 (124h55m41.062973062s) [seg_pos={0 0}, upload=99870]: Done begin upload segment. Jul 24 03:46:34.690415768 (124h55m41.062995123s) [noise=true , address=104.36.82.15:4290 , piece_id=FL6PZTAJWQGC4CNA2WPRDJKLCXW64VF2SIMXPNTNIKGVY36EHDYQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690459121 (124h55m41.063038476s) [noise=true , address=79.127.205.235:4681 , piece_id=WPCH3GH32C2EZ5CVM7FOGP3SH5DNNPCQVTU5663B7UYSEKV3KPXQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690762762 (124h55m41.063342117s) [noise=true , address=45.91.116.4:4960 , piece_id=QUYO65EI3L4CY7DCD6WSHO5KHRCGSJUXW4JAI4DSD5FFWJKVHHPA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690945873 (124h55m41.063525248s) [noise=true , address=79.127.205.245:4246 , piece_id=RRQ4TNEMI6LFAVRVBJ5M6QRW7LUE7YY6B4DGGL5N5Z6XU356337A, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691023591 (124h55m41.063602946s) [noise=true , address=104.36.82.21:4490 , piece_id=HHLUKA5GOEH2Q4XGN4GSHGY2LXXAXI2Z3WOX2ZKF7LAHGEGS6O7Q, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691270032 (124h55m41.063849387s) [noise=true , address=79.127.205.234:4618 , piece_id=JD34XM2B5RX2SBWZDTCDXPPLMVLKRDBBOCEOG23N2ZJ63QDHARRA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691281645 (124h55m41.063861s) [noise=true , address=64.49.13.170:4723 , piece_id=727RMYJFN7WHLV4SVER5Q5EMJ56JQXUIUNUV2AXFLEW4B3UWKJSQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691536132 (124h55m41.064115477s) [noise=true , address=77.90.31.21:4900 , piece_id=OY7AE7E5BGMN6K74B7VKI5PJZVDJPGIHCWPE3AATELD76VRHQHHQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691554708 (124h55m41.064134063s) [noise=true , address=104.36.82.47:4550 , piece_id=4B2A5Y33ZRILENDEDTN5RMH6HOBGDUQUEBX5AALH44AXVQUHRCAQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691787563 (124h55m41.064366908s) [noise=true , address=104.36.82.13:4204 , piece_id=SPG4BW4W2P6DFUL3DRPMZVPOMZDRQM4F3AGK4PAPOFB45PPI74PQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691817530 (124h55m41.064396885s) [noise=true , address=45.91.116.6:4005 , piece_id=BX3AGLZOW53YZLV5NW47ZKUGLCIZ74VAQ3G4ISHLBH2TO63ONIXQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692056247 (124h55m41.064635602s) [noise=true , address=104.36.82.53:4126 , piece_id=DB7HLDKSL7ZSODPPYEFYI43R26BV25G5SFTXDX4I7VDRWT6SNU6A, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692074232 (124h55m41.064653587s) [noise=true , address=79.127.219.51:4189 , piece_id=COVVSEYCJDKQO7SFQMVTZMPD3OEVIXJC7GZWTA7UCPFCC5D6ARVQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692258003 (124h55m41.064837358s) [noise=true , address=104.36.82.54:4160 , piece_id=L365VSJEHKQBSTCHIE3V6ZFHS44LRKTHXY6CTKPRU4DCWD24TQIQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692295345 (124h55m41.06487471s) [noise=true , address=104.36.82.41:4789 , piece_id=6S2WYDQ52XP5LMQFG53RSCNGSAESWC2KP57HXT6EZHUXUQ5IC4KA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692532308 (124h55m41.065111653s) [noise=true , address=79.127.219.47:4061 , piece_id=VBD53QPY4KBSOSNDCEPBJ3KUMY7SZOH2JTMMD2P363H2OBNGXUWA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692572074 (124h55m41.065151429s) [noise=true , address=79.127.220.97:4396 , piece_id=5DFG6K5M2IB7CQC3XONYXY34US2DGCOHVLWN767C4XTC6DYLTUEA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692752048 (124h55m41.065331403s) [noise=true , address=79.127.205.246:4277 , piece_id=SCSLJ7TZBW355N742GVJLOCSU65U3BDW7S5XFIGURMQQQAM4QECQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:35.791566899 (124h55m42.164146254s) [upload=99870]: Next returned nil segment Jul 24 03:46:35.791582809 (124h55m42.164162164s) [upload=99870]: Waiting for error group managing segments... Jul 24 03:46:36.080997534 (124h55m42.453576889s) [noise=true , address=79.127.205.235:4681 , piece_id=WPCH3GH32C2EZ5CVM7FOGP3SH5DNNPCQVTU5663B7UYSEKV3KPXQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.083231148 (124h55m42.455810503s) [noise=true , address=79.127.205.245:4246 , piece_id=RRQ4TNEMI6LFAVRVBJ5M6QRW7LUE7YY6B4DGGL5N5Z6XU356337A, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.106927646 (124h55m42.479507002s) [noise=true , address=79.127.205.234:4618 , piece_id=JD34XM2B5RX2SBWZDTCDXPPLMVLKRDBBOCEOG23N2ZJ63QDHARRA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.117524923 (124h55m42.490104278s) [noise=true , address=79.127.205.246:4277 , piece_id=SCSLJ7TZBW355N742GVJLOCSU65U3BDW7S5XFIGURMQQQAM4QECQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.159925739 (124h55m42.532505094s) [noise=true , address=64.49.13.170:4723 , piece_id=727RMYJFN7WHLV4SVER5Q5EMJ56JQXUIUNUV2AXFLEW4B3UWKJSQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.396214858 (124h55m42.768794223s) [noise=true , address=79.127.220.97:4396 , piece_id=5DFG6K5M2IB7CQC3XONYXY34US2DGCOHVLWN767C4XTC6DYLTUEA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.617341214 (124h55m42.989920569s) [noise=true , address=77.90.31.21:4900 , piece_id=OY7AE7E5BGMN6K74B7VKI5PJZVDJPGIHCWPE3AATELD76VRHQHHQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.647952274 (124h55m43.020531619s) [noise=true , address=79.127.219.51:4189 , piece_id=COVVSEYCJDKQO7SFQMVTZMPD3OEVIXJC7GZWTA7UCPFCC5D6ARVQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.658281035 (124h55m43.03086039s) [noise=true , address=45.91.116.6:4005 , piece_id=BX3AGLZOW53YZLV5NW47ZKUGLCIZ74VAQ3G4ISHLBH2TO63ONIXQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.678980550 (124h55m43.051559906s) [noise=true , address=104.36.82.54:4160 , piece_id=L365VSJEHKQBSTCHIE3V6ZFHS44LRKTHXY6CTKPRU4DCWD24TQIQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.684820484 (124h55m43.057399839s) [noise=true , address=104.36.82.41:4789 , piece_id=6S2WYDQ52XP5LMQFG53RSCNGSAESWC2KP57HXT6EZHUXUQ5IC4KA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.701129458 (124h55m43.073708813s) [noise=true , address=79.127.219.47:4061 , piece_id=VBD53QPY4KBSOSNDCEPBJ3KUMY7SZOH2JTMMD2P363H2OBNGXUWA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.709751916 (124h55m43.082331271s) [noise=true , address=104.36.82.13:4204 , piece_id=SPG4BW4W2P6DFUL3DRPMZVPOMZDRQM4F3AGK4PAPOFB45PPI74PQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.743120050 (124h55m43.115699405s) [noise=true , address=45.91.116.4:4960 , piece_id=QUYO65EI3L4CY7DCD6WSHO5KHRCGSJUXW4JAI4DSD5FFWJKVHHPA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.743145759 (124h55m43.115725114s) [seg_pos={0 0}, upload=99870]: Segment reached optimal threshold of 14 pieces. Jul 24 03:46:36.743253696 (124h55m43.115833051s) [noise=true , address=104.36.82.47:4550 , piece_id=4B2A5Y33ZRILENDEDTN5RMH6HOBGDUQUEBX5AALH44AXVQUHRCAQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fz8JANjsHWJkHj7Y2JAkr7NTKqDtcKjRW4kDaYGLJYwgWnxbS): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743373425 (124h55m43.115952781s) [noise=true , address=104.36.82.21:4490 , piece_id=HHLUKA5GOEH2Q4XGN4GSHGY2LXXAXI2Z3WOX2ZKF7LAHGEGS6O7Q, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DPUW1Ej5FLg9yTbhqdWBX8YAryWG82BnVegsCiTRX71pUA24n): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743416207 (124h55m43.115995552s) [noise=true , address=104.36.82.53:4126 , piece_id=DB7HLDKSL7ZSODPPYEFYI43R26BV25G5SFTXDX4I7VDRWT6SNU6A, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743443088 (124h55m43.116022443s) [noise=true , address=104.36.82.15:4290 , piece_id=FL6PZTAJWQGC4CNA2WPRDJKLCXW64VF2SIMXPNTNIKGVY36EHDYQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743469308 (124h55m43.116048663s) [seg_pos={0 0}, upload=99870]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 24 03:46:36.743577626 (124h55m43.116156981s) [upload=99870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 03:46:36.743582555 (124h55m43.1161619s) [upload=99870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 03:48:53.943482848 (124h58m0.316062223s) [upload=99870]: Done uploading segments... Jul 24 03:48:53.943509619 (124h58m0.316088974s) [upload=99870]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.631273525s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.590931898s FAIL (2025-07-24 04:32:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=99870]: Starting upload Jul 24 03:46:34.240675379 (124h55m40.613254734s) [upload=99870]: Done starting upload Jul 24 03:46:34.240780020 (124h55m40.613359375s) [upload=99870]: Uploading segments... Jul 24 03:46:34.240872236 (124h55m40.613451591s) [upload=99870]: Got next segment. Inline: false Jul 24 03:46:34.240909317 (124h55m40.613488672s) [upload=99870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 03:46:34.240914497 (124h55m40.613493852s) [upload=99870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 03:46:34.690348981 (124h55m41.062928336s) [seg_pos={0 0}, upload=99870]: Begin upload segment... Jul 24 03:46:34.690393707 (124h55m41.062973062s) [seg_pos={0 0}, upload=99870]: Done begin upload segment. Jul 24 03:46:34.690415768 (124h55m41.062995123s) [noise=true , address=104.36.82.15:4290 , piece_id=FL6PZTAJWQGC4CNA2WPRDJKLCXW64VF2SIMXPNTNIKGVY36EHDYQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690459121 (124h55m41.063038476s) [noise=true , address=79.127.205.235:4681 , piece_id=WPCH3GH32C2EZ5CVM7FOGP3SH5DNNPCQVTU5663B7UYSEKV3KPXQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690762762 (124h55m41.063342117s) [noise=true , address=45.91.116.4:4960 , piece_id=QUYO65EI3L4CY7DCD6WSHO5KHRCGSJUXW4JAI4DSD5FFWJKVHHPA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690945873 (124h55m41.063525248s) [noise=true , address=79.127.205.245:4246 , piece_id=RRQ4TNEMI6LFAVRVBJ5M6QRW7LUE7YY6B4DGGL5N5Z6XU356337A, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691023591 (124h55m41.063602946s) [noise=true , address=104.36.82.21:4490 , piece_id=HHLUKA5GOEH2Q4XGN4GSHGY2LXXAXI2Z3WOX2ZKF7LAHGEGS6O7Q, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691270032 (124h55m41.063849387s) [noise=true , address=79.127.205.234:4618 , piece_id=JD34XM2B5RX2SBWZDTCDXPPLMVLKRDBBOCEOG23N2ZJ63QDHARRA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691281645 (124h55m41.063861s) [noise=true , address=64.49.13.170:4723 , piece_id=727RMYJFN7WHLV4SVER5Q5EMJ56JQXUIUNUV2AXFLEW4B3UWKJSQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691536132 (124h55m41.064115477s) [noise=true , address=77.90.31.21:4900 , piece_id=OY7AE7E5BGMN6K74B7VKI5PJZVDJPGIHCWPE3AATELD76VRHQHHQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691554708 (124h55m41.064134063s) [noise=true , address=104.36.82.47:4550 , piece_id=4B2A5Y33ZRILENDEDTN5RMH6HOBGDUQUEBX5AALH44AXVQUHRCAQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691787563 (124h55m41.064366908s) [noise=true , address=104.36.82.13:4204 , piece_id=SPG4BW4W2P6DFUL3DRPMZVPOMZDRQM4F3AGK4PAPOFB45PPI74PQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691817530 (124h55m41.064396885s) [noise=true , address=45.91.116.6:4005 , piece_id=BX3AGLZOW53YZLV5NW47ZKUGLCIZ74VAQ3G4ISHLBH2TO63ONIXQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692056247 (124h55m41.064635602s) [noise=true , address=104.36.82.53:4126 , piece_id=DB7HLDKSL7ZSODPPYEFYI43R26BV25G5SFTXDX4I7VDRWT6SNU6A, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692074232 (124h55m41.064653587s) [noise=true , address=79.127.219.51:4189 , piece_id=COVVSEYCJDKQO7SFQMVTZMPD3OEVIXJC7GZWTA7UCPFCC5D6ARVQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692258003 (124h55m41.064837358s) [noise=true , address=104.36.82.54:4160 , piece_id=L365VSJEHKQBSTCHIE3V6ZFHS44LRKTHXY6CTKPRU4DCWD24TQIQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692295345 (124h55m41.06487471s) [noise=true , address=104.36.82.41:4789 , piece_id=6S2WYDQ52XP5LMQFG53RSCNGSAESWC2KP57HXT6EZHUXUQ5IC4KA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692532308 (124h55m41.065111653s) [noise=true , address=79.127.219.47:4061 , piece_id=VBD53QPY4KBSOSNDCEPBJ3KUMY7SZOH2JTMMD2P363H2OBNGXUWA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692572074 (124h55m41.065151429s) [noise=true , address=79.127.220.97:4396 , piece_id=5DFG6K5M2IB7CQC3XONYXY34US2DGCOHVLWN767C4XTC6DYLTUEA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692752048 (124h55m41.065331403s) [noise=true , address=79.127.205.246:4277 , piece_id=SCSLJ7TZBW355N742GVJLOCSU65U3BDW7S5XFIGURMQQQAM4QECQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:35.791566899 (124h55m42.164146254s) [upload=99870]: Next returned nil segment Jul 24 03:46:35.791582809 (124h55m42.164162164s) [upload=99870]: Waiting for error group managing segments... Jul 24 03:46:36.080997534 (124h55m42.453576889s) [noise=true , address=79.127.205.235:4681 , piece_id=WPCH3GH32C2EZ5CVM7FOGP3SH5DNNPCQVTU5663B7UYSEKV3KPXQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.083231148 (124h55m42.455810503s) [noise=true , address=79.127.205.245:4246 , piece_id=RRQ4TNEMI6LFAVRVBJ5M6QRW7LUE7YY6B4DGGL5N5Z6XU356337A, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.106927646 (124h55m42.479507002s) [noise=true , address=79.127.205.234:4618 , piece_id=JD34XM2B5RX2SBWZDTCDXPPLMVLKRDBBOCEOG23N2ZJ63QDHARRA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.117524923 (124h55m42.490104278s) [noise=true , address=79.127.205.246:4277 , piece_id=SCSLJ7TZBW355N742GVJLOCSU65U3BDW7S5XFIGURMQQQAM4QECQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.159925739 (124h55m42.532505094s) [noise=true , address=64.49.13.170:4723 , piece_id=727RMYJFN7WHLV4SVER5Q5EMJ56JQXUIUNUV2AXFLEW4B3UWKJSQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.396214858 (124h55m42.768794223s) [noise=true , address=79.127.220.97:4396 , piece_id=5DFG6K5M2IB7CQC3XONYXY34US2DGCOHVLWN767C4XTC6DYLTUEA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.617341214 (124h55m42.989920569s) [noise=true , address=77.90.31.21:4900 , piece_id=OY7AE7E5BGMN6K74B7VKI5PJZVDJPGIHCWPE3AATELD76VRHQHHQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.647952274 (124h55m43.020531619s) [noise=true , address=79.127.219.51:4189 , piece_id=COVVSEYCJDKQO7SFQMVTZMPD3OEVIXJC7GZWTA7UCPFCC5D6ARVQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.658281035 (124h55m43.03086039s) [noise=true , address=45.91.116.6:4005 , piece_id=BX3AGLZOW53YZLV5NW47ZKUGLCIZ74VAQ3G4ISHLBH2TO63ONIXQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.678980550 (124h55m43.051559906s) [noise=true , address=104.36.82.54:4160 , piece_id=L365VSJEHKQBSTCHIE3V6ZFHS44LRKTHXY6CTKPRU4DCWD24TQIQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.684820484 (124h55m43.057399839s) [noise=true , address=104.36.82.41:4789 , piece_id=6S2WYDQ52XP5LMQFG53RSCNGSAESWC2KP57HXT6EZHUXUQ5IC4KA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.701129458 (124h55m43.073708813s) [noise=true , address=79.127.219.47:4061 , piece_id=VBD53QPY4KBSOSNDCEPBJ3KUMY7SZOH2JTMMD2P363H2OBNGXUWA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.709751916 (124h55m43.082331271s) [noise=true , address=104.36.82.13:4204 , piece_id=SPG4BW4W2P6DFUL3DRPMZVPOMZDRQM4F3AGK4PAPOFB45PPI74PQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.743120050 (124h55m43.115699405s) [noise=true , address=45.91.116.4:4960 , piece_id=QUYO65EI3L4CY7DCD6WSHO5KHRCGSJUXW4JAI4DSD5FFWJKVHHPA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.743145759 (124h55m43.115725114s) [seg_pos={0 0}, upload=99870]: Segment reached optimal threshold of 14 pieces. Jul 24 03:46:36.743253696 (124h55m43.115833051s) [noise=true , address=104.36.82.47:4550 , piece_id=4B2A5Y33ZRILENDEDTN5RMH6HOBGDUQUEBX5AALH44AXVQUHRCAQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fz8JANjsHWJkHj7Y2JAkr7NTKqDtcKjRW4kDaYGLJYwgWnxbS): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743373425 (124h55m43.115952781s) [noise=true , address=104.36.82.21:4490 , piece_id=HHLUKA5GOEH2Q4XGN4GSHGY2LXXAXI2Z3WOX2ZKF7LAHGEGS6O7Q, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DPUW1Ej5FLg9yTbhqdWBX8YAryWG82BnVegsCiTRX71pUA24n): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743416207 (124h55m43.115995552s) [noise=true , address=104.36.82.53:4126 , piece_id=DB7HLDKSL7ZSODPPYEFYI43R26BV25G5SFTXDX4I7VDRWT6SNU6A, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743443088 (124h55m43.116022443s) [noise=true , address=104.36.82.15:4290 , piece_id=FL6PZTAJWQGC4CNA2WPRDJKLCXW64VF2SIMXPNTNIKGVY36EHDYQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743469308 (124h55m43.116048663s) [seg_pos={0 0}, upload=99870]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 24 03:46:36.743577626 (124h55m43.116156981s) [upload=99870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 03:46:36.743582555 (124h55m43.1161619s) [upload=99870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 03:48:53.943482848 (124h58m0.316062223s) [upload=99870]: Done uploading segments... Jul 24 03:48:53.943509619 (124h58m0.316088974s) [upload=99870]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.59095947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.778000884s FAIL (2025-07-24 04:31:48 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=99870]: Starting upload Jul 24 03:46:34.240675379 (124h55m40.613254734s) [upload=99870]: Done starting upload Jul 24 03:46:34.240780020 (124h55m40.613359375s) [upload=99870]: Uploading segments... Jul 24 03:46:34.240872236 (124h55m40.613451591s) [upload=99870]: Got next segment. Inline: false Jul 24 03:46:34.240909317 (124h55m40.613488672s) [upload=99870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 03:46:34.240914497 (124h55m40.613493852s) [upload=99870]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 03:46:34.690348981 (124h55m41.062928336s) [seg_pos={0 0}, upload=99870]: Begin upload segment... Jul 24 03:46:34.690393707 (124h55m41.062973062s) [seg_pos={0 0}, upload=99870]: Done begin upload segment. Jul 24 03:46:34.690415768 (124h55m41.062995123s) [noise=true , address=104.36.82.15:4290 , piece_id=FL6PZTAJWQGC4CNA2WPRDJKLCXW64VF2SIMXPNTNIKGVY36EHDYQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690459121 (124h55m41.063038476s) [noise=true , address=79.127.205.235:4681 , piece_id=WPCH3GH32C2EZ5CVM7FOGP3SH5DNNPCQVTU5663B7UYSEKV3KPXQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690762762 (124h55m41.063342117s) [noise=true , address=45.91.116.4:4960 , piece_id=QUYO65EI3L4CY7DCD6WSHO5KHRCGSJUXW4JAI4DSD5FFWJKVHHPA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.690945873 (124h55m41.063525248s) [noise=true , address=79.127.205.245:4246 , piece_id=RRQ4TNEMI6LFAVRVBJ5M6QRW7LUE7YY6B4DGGL5N5Z6XU356337A, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691023591 (124h55m41.063602946s) [noise=true , address=104.36.82.21:4490 , piece_id=HHLUKA5GOEH2Q4XGN4GSHGY2LXXAXI2Z3WOX2ZKF7LAHGEGS6O7Q, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691270032 (124h55m41.063849387s) [noise=true , address=79.127.205.234:4618 , piece_id=JD34XM2B5RX2SBWZDTCDXPPLMVLKRDBBOCEOG23N2ZJ63QDHARRA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691281645 (124h55m41.063861s) [noise=true , address=64.49.13.170:4723 , piece_id=727RMYJFN7WHLV4SVER5Q5EMJ56JQXUIUNUV2AXFLEW4B3UWKJSQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691536132 (124h55m41.064115477s) [noise=true , address=77.90.31.21:4900 , piece_id=OY7AE7E5BGMN6K74B7VKI5PJZVDJPGIHCWPE3AATELD76VRHQHHQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691554708 (124h55m41.064134063s) [noise=true , address=104.36.82.47:4550 , piece_id=4B2A5Y33ZRILENDEDTN5RMH6HOBGDUQUEBX5AALH44AXVQUHRCAQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691787563 (124h55m41.064366908s) [noise=true , address=104.36.82.13:4204 , piece_id=SPG4BW4W2P6DFUL3DRPMZVPOMZDRQM4F3AGK4PAPOFB45PPI74PQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.691817530 (124h55m41.064396885s) [noise=true , address=45.91.116.6:4005 , piece_id=BX3AGLZOW53YZLV5NW47ZKUGLCIZ74VAQ3G4ISHLBH2TO63ONIXQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692056247 (124h55m41.064635602s) [noise=true , address=104.36.82.53:4126 , piece_id=DB7HLDKSL7ZSODPPYEFYI43R26BV25G5SFTXDX4I7VDRWT6SNU6A, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692074232 (124h55m41.064653587s) [noise=true , address=79.127.219.51:4189 , piece_id=COVVSEYCJDKQO7SFQMVTZMPD3OEVIXJC7GZWTA7UCPFCC5D6ARVQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692258003 (124h55m41.064837358s) [noise=true , address=104.36.82.54:4160 , piece_id=L365VSJEHKQBSTCHIE3V6ZFHS44LRKTHXY6CTKPRU4DCWD24TQIQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692295345 (124h55m41.06487471s) [noise=true , address=104.36.82.41:4789 , piece_id=6S2WYDQ52XP5LMQFG53RSCNGSAESWC2KP57HXT6EZHUXUQ5IC4KA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692532308 (124h55m41.065111653s) [noise=true , address=79.127.219.47:4061 , piece_id=VBD53QPY4KBSOSNDCEPBJ3KUMY7SZOH2JTMMD2P363H2OBNGXUWA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692572074 (124h55m41.065151429s) [noise=true , address=79.127.220.97:4396 , piece_id=5DFG6K5M2IB7CQC3XONYXY34US2DGCOHVLWN767C4XTC6DYLTUEA, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:34.692752048 (124h55m41.065331403s) [noise=true , address=79.127.205.246:4277 , piece_id=SCSLJ7TZBW355N742GVJLOCSU65U3BDW7S5XFIGURMQQQAM4QECQ, seg_pos={0 0}, upload=99870]: Uploading piece... Jul 24 03:46:35.791566899 (124h55m42.164146254s) [upload=99870]: Next returned nil segment Jul 24 03:46:35.791582809 (124h55m42.164162164s) [upload=99870]: Waiting for error group managing segments... Jul 24 03:46:36.080997534 (124h55m42.453576889s) [noise=true , address=79.127.205.235:4681 , piece_id=WPCH3GH32C2EZ5CVM7FOGP3SH5DNNPCQVTU5663B7UYSEKV3KPXQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.083231148 (124h55m42.455810503s) [noise=true , address=79.127.205.245:4246 , piece_id=RRQ4TNEMI6LFAVRVBJ5M6QRW7LUE7YY6B4DGGL5N5Z6XU356337A, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.106927646 (124h55m42.479507002s) [noise=true , address=79.127.205.234:4618 , piece_id=JD34XM2B5RX2SBWZDTCDXPPLMVLKRDBBOCEOG23N2ZJ63QDHARRA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.117524923 (124h55m42.490104278s) [noise=true , address=79.127.205.246:4277 , piece_id=SCSLJ7TZBW355N742GVJLOCSU65U3BDW7S5XFIGURMQQQAM4QECQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.159925739 (124h55m42.532505094s) [noise=true , address=64.49.13.170:4723 , piece_id=727RMYJFN7WHLV4SVER5Q5EMJ56JQXUIUNUV2AXFLEW4B3UWKJSQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.396214858 (124h55m42.768794223s) [noise=true , address=79.127.220.97:4396 , piece_id=5DFG6K5M2IB7CQC3XONYXY34US2DGCOHVLWN767C4XTC6DYLTUEA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.617341214 (124h55m42.989920569s) [noise=true , address=77.90.31.21:4900 , piece_id=OY7AE7E5BGMN6K74B7VKI5PJZVDJPGIHCWPE3AATELD76VRHQHHQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.647952274 (124h55m43.020531619s) [noise=true , address=79.127.219.51:4189 , piece_id=COVVSEYCJDKQO7SFQMVTZMPD3OEVIXJC7GZWTA7UCPFCC5D6ARVQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.658281035 (124h55m43.03086039s) [noise=true , address=45.91.116.6:4005 , piece_id=BX3AGLZOW53YZLV5NW47ZKUGLCIZ74VAQ3G4ISHLBH2TO63ONIXQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.678980550 (124h55m43.051559906s) [noise=true , address=104.36.82.54:4160 , piece_id=L365VSJEHKQBSTCHIE3V6ZFHS44LRKTHXY6CTKPRU4DCWD24TQIQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.684820484 (124h55m43.057399839s) [noise=true , address=104.36.82.41:4789 , piece_id=6S2WYDQ52XP5LMQFG53RSCNGSAESWC2KP57HXT6EZHUXUQ5IC4KA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.701129458 (124h55m43.073708813s) [noise=true , address=79.127.219.47:4061 , piece_id=VBD53QPY4KBSOSNDCEPBJ3KUMY7SZOH2JTMMD2P363H2OBNGXUWA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.709751916 (124h55m43.082331271s) [noise=true , address=104.36.82.13:4204 , piece_id=SPG4BW4W2P6DFUL3DRPMZVPOMZDRQM4F3AGK4PAPOFB45PPI74PQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.743120050 (124h55m43.115699405s) [noise=true , address=45.91.116.4:4960 , piece_id=QUYO65EI3L4CY7DCD6WSHO5KHRCGSJUXW4JAI4DSD5FFWJKVHHPA, seg_pos={0 0}, upload=99870]: Done uploading piece. err: <nil> Jul 24 03:46:36.743145759 (124h55m43.115725114s) [seg_pos={0 0}, upload=99870]: Segment reached optimal threshold of 14 pieces. Jul 24 03:46:36.743253696 (124h55m43.115833051s) [noise=true , address=104.36.82.47:4550 , piece_id=4B2A5Y33ZRILENDEDTN5RMH6HOBGDUQUEBX5AALH44AXVQUHRCAQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fz8JANjsHWJkHj7Y2JAkr7NTKqDtcKjRW4kDaYGLJYwgWnxbS): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743373425 (124h55m43.115952781s) [noise=true , address=104.36.82.21:4490 , piece_id=HHLUKA5GOEH2Q4XGN4GSHGY2LXXAXI2Z3WOX2ZKF7LAHGEGS6O7Q, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DPUW1Ej5FLg9yTbhqdWBX8YAryWG82BnVegsCiTRX71pUA24n): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743416207 (124h55m43.115995552s) [noise=true , address=104.36.82.53:4126 , piece_id=DB7HLDKSL7ZSODPPYEFYI43R26BV25G5SFTXDX4I7VDRWT6SNU6A, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743443088 (124h55m43.116022443s) [noise=true , address=104.36.82.15:4290 , piece_id=FL6PZTAJWQGC4CNA2WPRDJKLCXW64VF2SIMXPNTNIKGVY36EHDYQ, seg_pos={0 0}, upload=99870]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF Jul 24 03:46:36.743469308 (124h55m43.116048663s) [seg_pos={0 0}, upload=99870]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 24 03:46:36.743577626 (124h55m43.116156981s) [upload=99870]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 03:46:36.743582555 (124h55m43.1161619s) [upload=99870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 03:48:53.943482848 (124h58m0.316062223s) [upload=99870]: Done uploading segments... Jul 24 03:48:53.943509619 (124h58m0.316088974s) [upload=99870]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.778034579s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)