Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.427974374s FAIL (2025-09-26 17:03:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.428038907s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.359277066s FAIL (2025-09-26 17:01:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.359312804s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.266667741s FAIL (2025-09-26 17:01:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.266701304s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.125261027s FAIL (2025-09-26 17:01:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.125317585s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.307659043s FAIL (2025-09-26 17:00:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.307689542s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.045197065s FAIL (2025-09-26 16:59:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.045225519s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.162509745s FAIL (2025-09-26 16:58:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.162545734s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.454833697s FAIL (2025-09-26 16:58:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.454864747s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.138565653s FAIL (2025-09-26 16:57:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.138597253s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.503383446s FAIL (2025-09-26 16:56:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.503414486s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.118304228s FAIL (2025-09-26 16:55:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.118334427s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.996341386s FAIL (2025-09-26 16:54:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 5.996372187s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.078846068s FAIL (2025-09-26 16:54:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.078880152s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.133597492s FAIL (2025-09-26 16:53:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.133627599s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.954082517s FAIL (2025-09-26 16:53:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.954109078s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.519288922s FAIL (2025-09-26 16:52:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.519315041s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.356408232s FAIL (2025-09-26 16:52:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.356454569s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.318569958s FAIL (2025-09-26 16:51:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.318606927s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 8.066284343s FAIL (2025-09-26 16:50:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 8.066320984s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.228262346s FAIL (2025-09-26 16:50:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.228295258s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.407354216s FAIL (2025-09-26 16:49:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.40738772s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.544001163s FAIL (2025-09-26 16:48:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.544033656s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 7.416512034s FAIL (2025-09-26 16:47:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 7.416548534s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.8799294s FAIL (2025-09-26 16:46:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.87995602s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.019663237s FAIL (2025-09-26 16:45:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.019694395s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.315986466s FAIL (2025-09-26 16:44:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.316022974s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.394633934s FAIL (2025-09-26 16:43:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.394669012s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.141520883s FAIL (2025-09-26 16:42:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.141552795s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.440329927s FAIL (2025-09-26 16:41:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.440361868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.417162013s FAIL (2025-09-26 16:41:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.41719231s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 9.303378581s FAIL (2025-09-26 16:40:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 9.30340912s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.23905292s FAIL (2025-09-26 16:39:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.239083868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.167929147s FAIL (2025-09-26 16:39:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.167964374s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.654257911s FAIL (2025-09-26 16:38:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.654287047s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.256567935s FAIL (2025-09-26 16:37:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.256596087s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.359511067s FAIL (2025-09-26 16:37:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.35957017s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.262420356s FAIL (2025-09-26 16:36:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.262452358s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.148315081s FAIL (2025-09-26 16:35:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.148363464s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.198503909s FAIL (2025-09-26 16:35:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.198534998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.947027926s FAIL (2025-09-26 16:34:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.947064186s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.132475861s FAIL (2025-09-26 16:34:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 6.132508492s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.27455041s FAIL (2025-09-26 16:33:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentBegin Sep 26 16:33:03.543754202 (75h1m49.005846695s) [seg_pos={0 0}, upload=66042]: Begin upload segment... Sep 26 16:33:03.543842831 (75h1m49.005935314s) [seg_pos={0 0}, upload=66042]: Done begin upload segment. Sep 26 16:33:03.543880282 (75h1m49.005972765s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.543932131 (75h1m49.006024614s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.544752603 (75h1m49.006845086s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545215454 (75h1m49.007307938s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.545695529 (75h1m49.007788012s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.547393132 (75h1m49.009485625s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549085534 (75h1m49.011178017s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.549177780 (75h1m49.011270253s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.551517705 (75h1m49.013610188s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.554184173 (75h1m49.016276656s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.555579830 (75h1m49.017672313s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.557508813 (75h1m49.019601296s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.558180493 (75h1m49.020272976s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.559965872 (75h1m49.022058355s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.560900652 (75h1m49.022993135s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:03.562163717 (75h1m49.0242562s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Uploading piece... Sep 26 16:33:05.645378113 (75h1m51.107470596s) [upload=66042]: Next returned nil segment Sep 26 16:33:05.645407599 (75h1m51.107500082s) [upload=66042]: Waiting for error group managing segments... Sep 26 16:33:06.141936517 (75h1m51.604029s) [noise=true , address=77.90.31.15:4699 , piece_id=ZUJFDOU7INDASEKJIFP2RS5YK5ZVBONJGQE53NYTI2C6L7STTIZA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.395281371 (75h1m51.857373854s) [noise=true , address=45.91.116.4:4938 , piece_id=AL2LT47YLVZPBTTWSANBM5E3VDSSJYCW3IGCLO5OIYWSVY5JMHGQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.428037264 (75h1m51.890129747s) [noise=true , address=45.91.116.8:4047 , piece_id=N7QBXE3WD6D63PSSHEYXQFI7S34IWM6L4ZUCQSKY6FHAQI3FTR2A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.520533092 (75h1m51.982625565s) [noise=true , address=77.90.31.19:4841 , piece_id=VGVSBHCXAKCGXCU4JZ5TTPS4H6L77NL4I462FHZMDLEZBK22N2CA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.625630226 (75h1m52.087722709s) [noise=true , address=77.90.31.12:4589 , piece_id=RYCVMIACQGIEBRJ4OLKS6XO6ARXACN74VJCGL4UY2QHJHVHDMZJQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.678056705 (75h1m52.140149188s) [noise=true , address=77.90.31.11:4553 , piece_id=EB44GM5GHN4YP75LW37KCCD4IMWJHFQ7P2SHQGO4TUFAVS7TFBFA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.708024448 (75h1m52.170116932s) [noise=true , address=77.90.31.16:4735 , piece_id=LY2RGOJIIA6M6XS65ZJYEB77OZS6BXAACJXSGMQDFX456QUFOBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.775446672 (75h1m52.237539165s) [noise=true , address=45.91.116.14:4189 , piece_id=3V4C5P62GGVYZANHTE6CSRT2PNMHAGUOFMNGHWGPXJB6Y76MCI4Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:06.862182823 (75h1m52.324275306s) [noise=true , address=77.90.31.18:4805 , piece_id=3LJYF6UCWAKNRE7EPMBZIK4ADRVPMYHVV3M6A7SWAY4LAXKFTHWA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:07.150372536 (75h1m52.612465019s) [noise=true , address=45.91.116.6:4974 , piece_id=SYUVRLBE7BRCJCHXNPI3LJLMJWALQA7TRSYGX5NADROIN7KYT5KA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: <nil> Sep 26 16:33:32.524113705 (75h2m17.986206188s) [noise=true , address=145.79.227.17:4972 , piece_id=DLVT64BS25MDV5BMJNVVWBTGU23JWSIAJTYD4IZUOIFVPWCJWK2Q, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39964->145.79.227.17:4972: use of closed network connection Sep 26 16:33:32.524278479 (75h2m17.986370952s) [noise=true , address=145.79.227.6:4258 , piece_id=TUCMOKQIHDIPTOC3QR3N2YT2TOBTBU2OPEZSI7JXXWOMX6RILBBA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37302->145.79.227.6:4258: use of closed network connection Sep 26 16:33:32.524287967 (75h2m17.98638045s) [noise=true , address=145.79.227.3:4149 , piece_id=6CQEMW2IOTWX3MWOCL6T5F3UPB5W77DCRVYGZY7OIQC5SRST4XCQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35594->145.79.227.3:4149: use of closed network connection Sep 26 16:33:32.524366997 (75h2m17.98645947s) [noise=true , address=145.79.227.18:4007 , piece_id=KMEGFCHJTJ33CTDKDEUI5RH6QK7GZWKQJ4BS3I2Y52CHYB6KSGGA, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44052->145.79.227.18:4007: use of closed network connection Sep 26 16:33:32.524396734 (75h2m17.986489207s) [noise=true , address=145.79.227.19:4077 , piece_id=K7HT56W62LZV35A4FSY4LEFR7UA25RJKV3FNQBXSVNJFTIC2VP4A, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45558->145.79.227.19:4077: use of closed network connection Sep 26 16:33:32.524503297 (75h2m17.98659577s) [noise=true , address=145.79.227.7:4295 , piece_id=FXSLWEEWYVLO4FRQ6WVYIPZ5BAUCPBVYWR3OWPJSAYIZCJXRCWIQ, seg_pos={0 0}, upload=66042]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:145.79.227.7:4295): protocol: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47202->145.79.227.7:4295: use of closed network connection Sep 26 16:33:32.524534356 (75h2m17.986626839s) [seg_pos={0 0}, upload=66042]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 26 16:33:32.796307951 (75h2m18.258400434s) [upload=66042]: Done uploading segments... Sep 26 16:33:32.796339381 (75h2m18.258431864s) [upload=66042]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration:* 30.274583152s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.457338833s FAIL (2025-09-26 15:14:09 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.457370382s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.285666539s FAIL (2025-09-26 15:13:09 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.28569868s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.201981208s FAIL (2025-09-26 15:11:58 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.202007647s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.321070244s FAIL (2025-09-26 15:11:16 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.321116973s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.040908105s FAIL (2025-09-26 15:11:00 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.041042472s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.226384344s FAIL (2025-09-26 15:10:34 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.226448677s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.528362394s FAIL (2025-09-26 15:10:07 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.528432816s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.225599141s FAIL (2025-09-26 15:09:12 UTC) orbiter warning: read tcp 188.166.225.170:57292->136.0.77.2:443: read: connection reset by peer Duration: 6.225632373s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)