Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.770667728s FAIL (2025-07-02 06:07:30 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.770702334s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.906088492s FAIL (2025-07-02 06:07:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.906115483s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.670350525s FAIL (2025-07-02 06:07:09 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.670376907s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.84720671s FAIL (2025-07-02 06:06:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.847220476s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000760002s FAIL (2025-07-02 06:06:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000783797s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.661402604s FAIL (2025-07-02 06:06:34 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.661433203s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.752179472s FAIL (2025-07-02 06:05:49 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.752200683s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.629204425s FAIL (2025-07-02 06:05:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.629227268s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.658108963s FAIL (2025-07-02 06:04:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.658130664s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.661982934s FAIL (2025-07-02 06:03:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.662018402s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.876701401s FAIL (2025-07-02 06:03:39 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.876735446s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.64979814s FAIL (2025-07-02 06:03:06 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.649826584s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.582445738s FAIL (2025-07-02 06:02:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.582478041s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.741970057s FAIL (2025-07-02 06:01:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.742011756s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.61394765s FAIL (2025-07-02 06:00:50 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.613997955s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.732954547s FAIL (2025-07-02 06:00:26 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.732980627s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.681257576s FAIL (2025-07-02 05:59:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.681286981s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.607988251s FAIL (2025-07-02 05:58:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.60801895s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.646705005s FAIL (2025-07-02 05:58:20 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.646745993s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.685487198s FAIL (2025-07-02 05:58:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.685513278s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.670966675s FAIL (2025-07-02 05:57:32 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.670991983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 8.944627271s FAIL (2025-07-02 05:57:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 8.944666617s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.623853113s FAIL (2025-07-02 05:56:34 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.623874363s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.643783616s FAIL (2025-07-02 05:55:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.643813783s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.646960414s FAIL (2025-07-02 05:54:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.647004979s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.972111947s FAIL (2025-07-02 05:53:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.972138329s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.60001296s FAIL (2025-07-02 05:52:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.600073666s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m19.819366907s FAIL (2025-07-02 05:52:29 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 33057701s) [noise=true , address=77.90.31.21:4877 , piece_id=MIQJKZPIULHKQYFT5ANV3ULTEULC6V6FBGT4GBBFKE75SJHA5P5A, seg_pos={0 0}, upload=170077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2): protocol: expected piece hash; context canceled; EOF Jul 2 05:49:27.162458798 (212h39m1.933100173s) [seg_pos={0 0}, upload=170077]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:49:27.162604125 (212h39m1.933245511s) [upload=170077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:49:27.162612772 (212h39m1.933254147s) [upload=170077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:49:27.459834790 (212h39m2.230476125s) [upload=170077]: Done uploading segments... Jul 2 05:49:27.459858125 (212h39m2.23049946s) [upload=170077]: Upload finished. err: <nil> Jul 2 05:50:10.576443205 (212h39m45.34708454s) [upload=170087]: Starting upload Jul 2 05:50:10.576578824 (212h39m45.347220159s) [upload=170087]: Done starting upload Jul 2 05:50:10.576656032 (212h39m45.347297367s) [upload=170087]: Uploading segments... Jul 2 05:50:10.576828953 (212h39m45.347470288s) [upload=170087]: Got next segment. Inline: false Jul 2 05:50:10.576859220 (212h39m45.347500556s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 05:50:10.576864240 (212h39m45.347505575s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 05:50:10.808702028 (212h39m45.579343363s) [seg_pos={0 0}, upload=170087]: Begin upload segment... Jul 2 05:50:10.808752013 (212h39m45.579393348s) [seg_pos={0 0}, upload=170087]: Done begin upload segment. Jul 2 05:50:10.808775979 (212h39m45.579417314s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.808808541 (212h39m45.579449887s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809108976 (212h39m45.579750311s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809199409 (212h39m45.579840744s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809343404 (212h39m45.579984739s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809468484 (212h39m45.580109819s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809566601 (212h39m45.580207936s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809741396 (212h39m45.580382731s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809786091 (212h39m45.580427426s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.809987076 (212h39m45.580628411s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810154466 (212h39m45.580795801s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810254087 (212h39m45.580895422s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810444401 (212h39m45.581085736s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810549342 (212h39m45.581190677s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810639985 (212h39m45.58128132s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:10.810836050 (212h39m45.581477385s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Uploading piece... Jul 2 05:50:12.497702968 (212h39m47.268344303s) [upload=170087]: Next returned nil segment Jul 2 05:50:12.497758344 (212h39m47.268399679s) [upload=170087]: Waiting for error group managing segments... Jul 2 05:50:12.786708957 (212h39m47.557350282s) [noise=true , address=104.36.82.9:4005 , piece_id=VCDXR7AP5LAQYG3DGOQXG4VE2DBZPTFUFTC5UG62O2Q2EUOLU3JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.786763041 (212h39m47.557404376s) [noise=true , address=104.36.82.2:4730 , piece_id=K76VXRB53GNZY64MN6VV542BEUEDKETCBHZKVFR75B672LYLMY6Q, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.806312102 (212h39m47.576953437s) [noise=true , address=104.36.82.6:4873 , piece_id=UA5XWYUASVTQO3DYTTMXDX7XNI567AC5GDPOMCP7VZ3NBWTORHCA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.824384578 (212h39m47.595025913s) [noise=true , address=104.36.82.14:4221 , piece_id=OTNAXF723VCNEP3Y3FISABPXDXIYZW7WETIOI6ET4ISTFRXDH42A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.838516715 (212h39m47.60915805s) [noise=true , address=104.36.82.16:4294 , piece_id=DSC3LD6TEAFJG4PZGOE5XJRHL6DGOB23BJKYG6OXUF4FHV57ITOQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842143875 (212h39m47.61278521s) [noise=true , address=45.91.116.11:4117 , piece_id=ZHVI5L2VO2AIOMK4A5V32AXQ5OXDOMZVRAL4J5FHNWRPUGAURM5A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.842170876 (212h39m47.612812211s) [noise=true , address=104.36.82.14:4223 , piece_id=T47ENG4WLEYUUUC5UHUE5H7DGZFOHN75MCZKGBRCKHVF62H74R2A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.847660860 (212h39m47.618302195s) [noise=true , address=45.91.116.7:4009 , piece_id=TZ35AEP3ULZIUZENBLPS7OH6UPXVGAU2ALCJNPURLSLPDKYXGWVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.849814209 (212h39m47.620455544s) [noise=true , address=45.91.116.8:4047 , piece_id=A5H7DDPS3F5HAQ3IGU64GCAZ4SGQPBHUMKHUIO2KDKMDEMYED6KQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.868470061 (212h39m47.639111396s) [noise=true , address=77.90.31.11:4555 , piece_id=A5C7MNN2SCQTAOAX7DAZ75IU2NUHIOEIRVMMA3YBT66ADX4L245A, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912562127 (212h39m47.683203472s) [noise=true , address=45.91.116.6:4975 , piece_id=RLDSR5V7NKOPW3CFVECKWFVANLWRILHOGKLEZJZM4HA622ZL6CBQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.912882240 (212h39m47.683523575s) [noise=true , address=45.91.116.12:4225 , piece_id=O3CEYCZBQNUN3JBRI4XQNVEW6QFPWVWPARMSNMHQXT5XOPTIKKIQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.917969412 (212h39m47.688610757s) [noise=true , address=45.91.116.13:4154 , piece_id=EJZ3TEZTKTIWIVQBMPZ2DXVBK2Z3SYVC4OJ2CAOUZ2YYNKCA5RWA, seg_pos={0 0}, upload=170087]: Done uploading piece. err: <nil> Jul 2 05:50:12.918003127 (212h39m47.688644482s) [seg_pos={0 0}, upload=170087]: Segment reached optimal threshold of 13 pieces. Jul 2 05:50:12.918257053 (212h39m47.688898388s) [noise=true , address=45.91.116.5:4299 , piece_id=BGBI64TH63M5CVR2NW4KRIYBKNGACEVHLCKXWMWWHJ5JJPYSSRKQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918269927 (212h39m47.688911262s) [noise=true , address=45.91.116.10:4081 , piece_id=O2TURAXXQM4TXMTEKE557QI5EZORTXAH3VEPSCSTDUXNL6RCMQVQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918347345 (212h39m47.68898868s) [noise=true , address=77.90.31.17:4770 , piece_id=2TT5RR5GBUT7TK2PRNCOHFCVVPDELCDNXH4RHIQM5UD2EJ5VY2JQ, seg_pos={0 0}, upload=170087]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 2 05:50:12.918369819 (212h39m47.689011154s) [seg_pos={0 0}, upload=170087]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 05:50:12.918447417 (212h39m47.689088752s) [upload=170087]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 05:50:12.918451425 (212h39m47.68909275s) [upload=170087]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 05:52:29.749365718 (212h42m4.520007053s) [upload=170087]: Done uploading segments... Jul 2 05:52:29.749385846 (212h42m4.520027182s) [upload=170087]: Upload finished. err: metaclient: context deadline exceeded Duration: 2m19.819405992s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.81803275s FAIL (2025-07-02 05:00:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.818058668s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.686275386s FAIL (2025-07-02 04:59:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.686305414s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.773260595s FAIL (2025-07-02 04:59:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.773289259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.786777254s FAIL (2025-07-02 04:58:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.786807662s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.640595465s FAIL (2025-07-02 04:57:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.640651112s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.953658375s FAIL (2025-07-02 04:57:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.953684433s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 14.418069345s FAIL (2025-07-02 04:56:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 14.418094904s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.624069833s FAIL (2025-07-02 04:55:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.624093887s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.671756182s FAIL (2025-07-02 04:54:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.671780067s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.750148592s FAIL (2025-07-02 04:53:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.75017852s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.59579094s FAIL (2025-07-02 04:52:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.595834863s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.687586167s FAIL (2025-07-02 04:51:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.687614462s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.626410549s FAIL (2025-07-02 04:50:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.62643765s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.639472891s FAIL (2025-07-02 04:49:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.639496767s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.085925695s FAIL (2025-07-02 04:48:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.085946104s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.662173869s FAIL (2025-07-02 04:47:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.662201653s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.629468759s FAIL (2025-07-02 04:46:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.629495301s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.567325291s FAIL (2025-07-02 04:45:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.567352444s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.651420309s FAIL (2025-07-02 04:44:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.651448873s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.669112476s FAIL (2025-07-02 04:43:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.669133935s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.717092414s FAIL (2025-07-02 04:42:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.717124906s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.655153453s FAIL (2025-07-02 04:41:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== ush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 04:12:26.387385353 (211h2m1.158026679s) [upload=168817]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 04:12:26.675658004 (211h2m1.446299329s) [upload=168817]: Done uploading segments... Jul 2 04:12:26.675673784 (211h2m1.446315119s) [upload=168817]: Upload finished. err: <nil> Jul 2 04:13:31.474556357 (211h3m6.245197692s) [upload=168832]: Starting upload Jul 2 04:13:31.474610561 (211h3m6.245251896s) [upload=168832]: Done starting upload Jul 2 04:13:31.474732024 (211h3m6.245373359s) [upload=168832]: Uploading segments... Jul 2 04:13:31.474790095 (211h3m6.24543143s) [upload=168832]: Got next segment. Inline: false Jul 2 04:13:31.474814822 (211h3m6.245456157s) [upload=168832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 04:13:31.474819090 (211h3m6.245460415s) [upload=168832]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 04:13:31.711289277 (211h3m6.481930612s) [seg_pos={0 0}, upload=168832]: Begin upload segment... Jul 2 04:13:31.711327530 (211h3m6.481968865s) [seg_pos={0 0}, upload=168832]: Done begin upload segment. Jul 2 04:13:31.711344092 (211h3m6.481985437s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711350844 (211h3m6.481992179s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711381894 (211h3m6.482023229s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711712867 (211h3m6.482354192s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711721924 (211h3m6.482363259s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.711965660 (211h3m6.482606995s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712207002 (211h3m6.482848337s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.712474514 (211h3m6.483115839s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.713982268 (211h3m6.484623603s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714206547 (211h3m6.484847882s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714452207 (211h3m6.485093542s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714704500 (211h3m6.485345825s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.714963496 (211h3m6.485604831s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715250605 (211h3m6.48589194s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715546020 (211h3m6.486187356s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:31.715784957 (211h3m6.486426282s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Uploading piece... Jul 2 04:13:33.312716396 (211h3m8.083357731s) [upload=168832]: Next returned nil segment Jul 2 04:13:33.312734039 (211h3m8.083375374s) [upload=168832]: Waiting for error group managing segments... Jul 2 04:13:33.599257192 (211h3m8.369898517s) [noise=true , address=104.36.82.11:4115 , piece_id=ZUETVJUM635YFQ5O2DL2XOOV2356MIPCRCRWZEYTGP2CIPBVC7GQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.640829223 (211h3m8.411470559s) [noise=true , address=104.36.82.9:4006 , piece_id=NEJ2UKW4EYJWCIQZNPF5GBM3K46NV4HSELYXJCHYHJXOUMU3LNAA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.641404835 (211h3m8.41204617s) [noise=true , address=104.36.82.10:4079 , piece_id=DMRPZ3TANJSQT64YS2KA5CL2QBZ4RH5XR3UCLAWT32EDIAXGJYQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.750428801 (211h3m8.521070136s) [noise=true , address=104.36.82.8:4972 , piece_id=HWT7SJ2WHFPFJS46HN4TLFTOGJYD6PDR73NVUJTCQVOHJLSUZGOA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.759426104 (211h3m8.530067429s) [noise=true , address=104.36.82.5:4837 , piece_id=5MM32E4WUSDJWFJMWYH2DVAE3LHH35CGESV7BKCO6QVELZGJXNZA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:33.813623400 (211h3m8.584264735s) [noise=true , address=104.36.82.7:4912 , piece_id=434QVIDL2ZWSJQAWLXC5AB2EJI4QJUMUS3H5WAQLMQWV5NJFDQZQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:52.644497091 (211h3m27.415138426s) [noise=true , address=77.90.31.18:4805 , piece_id=GSFSJM6H6PBJBWELLNCT5RRYM6GLX5DVUMTKGNN5GUG4SN7IBJNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:53.416464828 (211h3m28.187106163s) [noise=true , address=45.91.116.11:4118 , piece_id=S5CIRWRTJGL25WZ3J6GT5GRDVTGDXQ6JOJLEYR2FSENY3TFBJH5A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:54.268176565 (211h3m29.0388179s) [noise=true , address=45.91.116.9:4261 , piece_id=S6NZB6X2P5VDCA3PFUOWJNK2YNGGOWCPZYD7WK3TRKFPBOMR7C2Q, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.205115451 (211h3m29.975756786s) [noise=true , address=45.91.116.10:4082 , piece_id=MPFJWXUJ3NDDLTWB2VVQPKWZAFNC4FZQDE6SHJJPW7KXKCAW37FA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:13:55.235263728 (211h3m30.005905063s) [noise=true , address=45.91.116.5:4298 , piece_id=LLYFJ6GPPMODLRE5LZZJXQOVQKOVJ6EVKKIKPMCMRVND7H2WBEQA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: <nil> Jul 2 04:14:00.823234032 (211h3m35.593875367s) [noise=true , address=45.91.116.5:4297 , piece_id=ED6SPYTR22NV6LGT73IHJJLSQ25EAQJMDPXX2GZSVW7H2GFQRU6A, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: expected piece hash; context deadline exceeded; EOF Jul 2 04:14:00.823299347 (211h3m35.593940682s) [noise=true , address=77.90.31.16:4734 , piece_id=QX6ZBTJUA6KH5PF6BWHTIRGJ3R46RE4A4W6TCMRO76DEBVWZTNXQ, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 188.166.225.170:32986->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823310819 (211h3m35.593952154s) [noise=true , address=77.90.31.14:4661 , piece_id=NDED32M2DJKMKSLH6MWQHMTS6QWTFGPPXD4HUNBQ4AZY2XAJHNBA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:51240->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 2 04:14:00.823384240 (211h3m35.594025575s) [noise=true , address=45.91.116.12:4226 , piece_id=FORMLEQITRYKTXG6ZA2DAKPZXBE2GKEDPRG43G7EUTZJGANRMGIA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56388->45.91.116.12:4226: use of closed network connection Jul 2 04:14:00.823396292 (211h3m35.594037627s) [noise=true , address=77.90.31.17:4772 , piece_id=EEQNJFWGKQ6MDIWMFYYN4WXJBT4DIIK6W7242P5RH7YNNEXBZTNA, seg_pos={0 0}, upload=168832]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58032->77.90.31.17:4772: use of closed network connection Jul 2 04:14:00.823414087 (211h3m35.594055422s) [seg_pos={0 0}, upload=168832]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 2 04:14:01.058258351 (211h3m35.828899686s) [upload=168832]: Done uploading segments... Jul 2 04:14:01.058282947 (211h3m35.828924282s) [upload=168832]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.655178923s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)