Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.878840461s FAIL (2025-10-25 16:29:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.878873453s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 23.342213084s FAIL (2025-10-25 16:28:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 23.342282546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.887461248s FAIL (2025-10-25 16:27:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.887510742s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 7.159932072s FAIL (2025-10-25 16:26:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 7.159965213s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.056345528s FAIL (2025-10-25 16:26:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.056379521s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.949143362s FAIL (2025-10-25 16:25:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.949178869s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.975434253s FAIL (2025-10-25 16:24:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.975468328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.924799226s FAIL (2025-10-25 16:23:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.924828182s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.920516199s FAIL (2025-10-25 16:23:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.920548421s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 7.793073871s FAIL (2025-10-25 16:22:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 7.793108127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.005568649s FAIL (2025-10-25 16:21:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.005643491s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.209261901s FAIL (2025-10-25 16:21:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.209290355s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.269101092s FAIL (2025-10-25 16:21:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.269135968s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.034403255s FAIL (2025-10-25 16:20:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.03442236s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.120237307s FAIL (2025-10-25 16:19:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.120269449s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.998084299s FAIL (2025-10-25 16:19:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.998118734s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.959842403s FAIL (2025-10-25 16:18:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.959868675s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.228814782s FAIL (2025-10-25 16:17:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.2288501s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.128267731s FAIL (2025-10-25 16:17:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.128311865s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.081612848s FAIL (2025-10-25 16:16:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.081644578s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.888390536s FAIL (2025-10-25 16:15:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.888422998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 12.929348755s FAIL (2025-10-25 16:14:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 12.929379834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.033144974s FAIL (2025-10-25 16:14:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.033170623s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.078700494s FAIL (2025-10-25 16:13:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.078736283s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.95871813s FAIL (2025-10-25 16:12:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.95875452s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 7.588789559s FAIL (2025-10-25 16:11:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 7.588813995s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.850357296s FAIL (2025-10-25 16:10:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.85038544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.967783285s FAIL (2025-10-25 16:09:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.967809376s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.683400687s FAIL (2025-10-25 16:09:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.683434421s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.026189621s FAIL (2025-10-25 16:08:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.026243564s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.026811867s FAIL (2025-10-25 16:07:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.026840723s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.215753726s FAIL (2025-10-25 16:06:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.215796598s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.947740732s FAIL (2025-10-25 16:06:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.947776849s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 7.936393789s FAIL (2025-10-25 16:05:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 7.936444364s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.00796844s FAIL (2025-10-25 16:05:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.007996011s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.911671435s FAIL (2025-10-25 16:04:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.911690683s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.034611739s FAIL (2025-10-25 16:03:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.034660251s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.119494023s FAIL (2025-10-25 16:02:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.119527626s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.756391494s FAIL (2025-10-25 16:02:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.75642599s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.948015302s FAIL (2025-10-25 16:01:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.948051s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.844244403s FAIL (2025-10-25 16:00:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.844278487s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.086916736s FAIL (2025-10-25 15:59:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.086954849s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.995590665s FAIL (2025-10-25 15:59:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.995658856s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.06213707s FAIL (2025-10-25 15:58:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.062183027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.926141293s FAIL (2025-10-25 15:57:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.926173274s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.993801935s FAIL (2025-10-25 15:57:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.993862239s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.079947341s FAIL (2025-10-25 15:56:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 6.079980693s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.952177702s FAIL (2025-10-25 15:55:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.952206617s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.867278436s FAIL (2025-10-25 15:54:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.867326648s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.773331292s FAIL (2025-10-25 15:53:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, Piece ID: DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ) context deadline exceeded; piecestore: (Node ID: 1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, Piece ID: JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A) context deadline exceeded ======LOGS====== 770h15m8.490609609s) [upload=677465]: Got next segment. Inline: false Oct 25 15:46:23.028545130 (770h15m8.490637603s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 25 15:46:23.028549678 (770h15m8.490642161s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 25 15:46:23.313104540 (770h15m8.775197013s) [seg_pos={0 0}, upload=677465]: Begin upload segment... Oct 25 15:46:23.313176907 (770h15m8.77526938s) [seg_pos={0 0}, upload=677465]: Done begin upload segment. Oct 25 15:46:23.313217484 (770h15m8.775310068s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.313933338 (770h15m8.776025811s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314076721 (770h15m8.776169204s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314435584 (770h15m8.776528057s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314487393 (770h15m8.776579866s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314713583 (770h15m8.776806056s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.314913334 (770h15m8.777005807s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315066134 (770h15m8.777158608s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315258571 (770h15m8.777351084s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315488268 (770h15m8.777580781s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.315740309 (770h15m8.777832782s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316142484 (770h15m8.778234967s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.316535964 (770h15m8.778628447s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317137820 (770h15m8.779230293s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317293466 (770h15m8.779385949s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:23.317683007 (770h15m8.77977548s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Uploading piece... Oct 25 15:46:25.049345446 (770h15m10.511437929s) [upload=677465]: Next returned nil segment Oct 25 15:46:25.049377918 (770h15m10.511470401s) [upload=677465]: Waiting for error group managing segments... Oct 25 15:46:25.325760294 (770h15m10.787852778s) [noise=true , address=145.79.227.10:4402 , piece_id=3X7RRFCV4FRBQ2W5XBPYJYTXAPRSOTB3IZVBYEX2L7PZBWNZCNAA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.344223872 (770h15m10.806316365s) [noise=true , address=145.79.227.7:4295 , piece_id=OX3CIL6IZ6ZVQJKYDYMPTJYVTLFZLR77NT6QCTC2RTEF6ZL7IKMA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.345093528 (770h15m10.807186011s) [noise=true , address=145.79.227.2:4115 , piece_id=MCURXIMLSQRNCIQPWTOBQEKBNKXCEJP2PUAOSA5Z7R2LYSNER6YQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.351771585 (770h15m10.813864058s) [noise=true , address=145.79.227.23:4547 , piece_id=GKXSU2XDKNFADRCMH4I3PXOPQISTLMPUJFEDOH4UQFAV2YZNDISQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.374174775 (770h15m10.836267248s) [noise=true , address=145.79.227.11:4732 , piece_id=A5ILYM33QJBA2BA3LDQ3OZJ6DFAIZDSKPSZDM5USE32N3PICE7RA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.388139316 (770h15m10.850231789s) [noise=true , address=145.79.227.3:4149 , piece_id=KORYLRCDVSUDWDXIYCLYVM3KDCA6YSJBPM6Z44PO7NVFDM57O5TA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.420298894 (770h15m10.882391378s) [noise=true , address=145.79.227.19:4078 , piece_id=CV5MOL7TVGE3N3IFT5OFAKC6JQ5ENOXQY3EO6V2ZERA7D5LWUJEQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.422360790 (770h15m10.884453263s) [noise=true , address=145.79.227.5:4223 , piece_id=VALQBEICIFDVFFJSJQPPF4ICMR43KNPDH36JFW2PXB4IHEQK53SA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.426679014 (770h15m10.888771487s) [noise=true , address=145.79.227.13:4804 , piece_id=XKBEFSPQ7UOXYAPRRYQ76FAR7VY4WRKM4BIMJAZUOBRDJTUFGUCQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.437342328 (770h15m10.899434812s) [noise=true , address=145.79.227.20:4438 , piece_id=3BHBEZFDTYTLRZZ4FU5VZLL24W55JTI6TVBEUFME57ZF33CHCZEA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.623389970 (770h15m11.085482443s) [noise=true , address=77.90.31.19:4841 , piece_id=JCNTTOYTVPCGJCKVIWQ7WSF5SBILB2PDM5ZII3F3N2NOZHXTOI5A, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.641353515 (770h15m11.103445998s) [noise=true , address=77.90.31.17:4772 , piece_id=NYWZOK5Q6AZ3F45A7CAO4BZC3X5K725HZVGZXMIOPJNPGNA4ZFQA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715951253 (770h15m11.178043726s) [noise=true , address=77.90.31.12:4589 , piece_id=DFPQY43H7RVE3KYQO3XPBYDTJLMH6TDATZ2FXDBTCG6HQAHK7TKQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: <nil> Oct 25 15:46:25.715978956 (770h15m11.178071439s) [seg_pos={0 0}, upload=677465]: Segment reached optimal threshold of 13 pieces. Oct 25 15:46:25.716168096 (770h15m11.178260589s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48524->77.90.31.11:4553: use of closed network connection Oct 25 15:46:25.716179509 (770h15m11.178271992s) [noise=true , address=77.90.31.11:4553 , piece_id=NPF6KID3QVGWB5YVU4SKBUIIVXXP4HGTFPD2DHGY3JIOUUIXPVPA, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716228491 (770h15m11.178320974s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56996->45.91.116.8:4045: use of closed network connection Oct 25 15:46:25.716239081 (770h15m11.178331564s) [noise=true , address=45.91.116.8:4045 , piece_id=TZ4Q6LTOJXJRSBOUAT3IPNRHBAOHKUYEM5NUIPHAVHYHPOTDJB7Q, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716349041 (770h15m11.178441525s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: write tcp 188.166.225.170:33862->45.91.116.4:4938: use of closed network connection; context canceled Oct 25 15:46:25.716356455 (770h15m11.178448938s) [noise=true , address=45.91.116.4:4938 , piece_id=IFXYOHXIXKNDRTJHRYMTGAADHUYFIZRT5MBK36AGA5ULTMBCBXJQ, seg_pos={0 0}, upload=677465]: Long tail cancellation due to optimal threshold Oct 25 15:46:25.716368648 (770h15m11.178461121s) [seg_pos={0 0}, upload=677465]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 25 15:46:25.716430256 (770h15m11.178522729s) [upload=677465]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 25 15:46:25.716435415 (770h15m11.178527889s) [upload=677465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 25 15:46:26.010542744 (770h15m11.472635227s) [upload=677465]: Done uploading segments... Oct 25 15:46:26.010565246 (770h15m11.472657729s) [upload=677465]: Upload finished. err: <nil> Duration: 5.773384564s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)