Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.555373599s FAIL (2025-09-11 23:54:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.555401944s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.716507525s FAIL (2025-09-11 23:53:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.716536861s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.679834655s FAIL (2025-09-11 23:52:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.679864112s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.35140329s FAIL (2025-09-11 23:52:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.351431714s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.82531733s FAIL (2025-09-11 23:51:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.825348379s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.431772913s FAIL (2025-09-11 23:50:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.431797881s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.345265011s FAIL (2025-09-11 23:49:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.345290068s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.699911548s FAIL (2025-09-11 23:48:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.699937628s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.638352518s FAIL (2025-09-11 23:47:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.638378889s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.609523034s FAIL (2025-09-11 23:47:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.609546962s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.411259572s FAIL (2025-09-11 23:46:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.411283538s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.589946245s FAIL (2025-09-11 23:45:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.58997516s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.87295759s FAIL (2025-09-11 23:44:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.872990382s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.600351713s FAIL (2025-09-11 23:44:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.600375959s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.660412945s FAIL (2025-09-11 23:43:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.660440697s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.548650735s FAIL (2025-09-11 23:42:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.548679519s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 7.025660228s FAIL (2025-09-11 23:42:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 7.025684556s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.460730812s FAIL (2025-09-11 23:41:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.460756343s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.613915309s FAIL (2025-09-11 23:40:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.613937552s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.692253022s FAIL (2025-09-11 23:40:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.692287027s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 7.017336798s FAIL (2025-09-11 23:39:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 7.017364249s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.897235413s FAIL (2025-09-11 23:39:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.897263297s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.624927902s FAIL (2025-09-11 23:38:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.62495303s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.632941433s FAIL (2025-09-11 23:37:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.632964375s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.84366516s FAIL (2025-09-11 23:36:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.843694677s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.921145757s FAIL (2025-09-11 23:36:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.921170124s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.760600901s FAIL (2025-09-11 23:35:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.760632071s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.576615221s FAIL (2025-09-11 23:35:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.576640299s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.440525577s FAIL (2025-09-11 23:34:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.440551848s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.611843768s FAIL (2025-09-11 23:33:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.611873556s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.72131607s FAIL (2025-09-11 23:33:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.721345197s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.803803659s FAIL (2025-09-11 23:32:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.803833698s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.600877051s FAIL (2025-09-11 23:32:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.600902069s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 7.050733297s FAIL (2025-09-11 23:31:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 7.050761782s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.821465395s FAIL (2025-09-11 23:30:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.821494793s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.671673512s FAIL (2025-09-11 23:29:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 6.671689031s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001897774s FAIL (2025-09-11 23:29:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== load Sep 11 23:28:07.993981773 (129h59m44.033554893s) [upload=114431]: Done starting upload Sep 11 23:28:07.994118555 (129h59m44.033691675s) [upload=114431]: Uploading segments... Sep 11 23:28:07.994370406 (129h59m44.033943526s) [upload=114431]: Got next segment. Inline: false Sep 11 23:28:07.994413479 (129h59m44.033986599s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 23:28:07.994418258 (129h59m44.033991378s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 23:28:08.526314903 (129h59m44.565888023s) [seg_pos={0 0}, upload=114431]: Begin upload segment... Sep 11 23:28:08.526394927 (129h59m44.565968047s) [seg_pos={0 0}, upload=114431]: Done begin upload segment. Sep 11 23:28:08.526583618 (129h59m44.566156738s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.526669492 (129h59m44.566242612s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.527055370 (129h59m44.56662849s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528127762 (129h59m44.567700882s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528628741 (129h59m44.568201871s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.528937662 (129h59m44.568510792s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529150039 (129h59m44.568723169s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529439973 (129h59m44.569013093s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529669513 (129h59m44.569242633s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.529967303 (129h59m44.569540423s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530242179 (129h59m44.569815299s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530542011 (129h59m44.570115131s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.530732065 (129h59m44.570305195s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531039234 (129h59m44.570612364s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531148673 (129h59m44.570721793s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531525734 (129h59m44.571098854s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.531754252 (129h59m44.571327362s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:08.532038766 (129h59m44.571611886s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Uploading piece... Sep 11 23:28:10.087174906 (129h59m46.126748016s) [upload=114431]: Next returned nil segment Sep 11 23:28:10.087192689 (129h59m46.126765809s) [upload=114431]: Waiting for error group managing segments... Sep 11 23:28:10.800552770 (129h59m46.84012588s) [noise=true , address=145.79.227.24:4583 , piece_id=NVWQMYTUQDXZKQXLFBPABMMUFHBGLYXATDEEWKBYQ3GK4FQU6V7Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.884789914 (129h59m46.924363034s) [noise=true , address=145.79.227.22:4517 , piece_id=N5VLOLET4N73GT6NU57BEQU6O5LGY443YB64RZ2IWQTBIAIJD3VQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.956136213 (129h59m46.995709353s) [noise=true , address=45.91.116.11:4147 , piece_id=Y5D7LMJAYRRBOU4377SWCDIOLCBXOYL43RPIMAPXNEF6EZPMVA4A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:10.970019599 (129h59m47.00959276s) [noise=true , address=145.79.227.50:4397 , piece_id=34F7E2NFLML7UFLIGM7NJLOWJCNO7TOT3U7CUDTQOYLYLORKQW2A, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.020237389 (129h59m47.059810509s) [noise=true , address=145.79.227.21:4503 , piece_id=TXTDCUDHFH3GDECCBSSLADDZWAEZN62LI2A2TR3KHOYF5NLFZ4CA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.032339235 (129h59m47.071912355s) [noise=true , address=145.79.227.47:4294 , piece_id=FHK6OTUTIOXKXOFOUTUQBBB2FIGMQWSOJ2GFDRQAGRX5INAZNWUA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.043987052 (129h59m47.083560172s) [noise=true , address=145.79.227.3:4158 , piece_id=JC2S64NWTUA62TJIXHI2PP3FHDDRY7TSQD5NVO3NWF6RIVIWUMNA, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.093211242 (129h59m47.132784362s) [noise=true , address=145.79.227.40:4077 , piece_id=HK4SEWESSBUQNZQ3V3MVTD4YBFO5WGXZ6QAPTRSKNI3OHLBTCHMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.114323128 (129h59m47.153896248s) [noise=true , address=145.79.227.41:4103 , piece_id=BRJZDXTCLA2WDIE6IEWC62B4YVJ54RRC66A3HPYTGN4IQZGFE7MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.138828468 (129h59m47.178401588s) [noise=true , address=145.79.227.29:4976 , piece_id=5QIEOW23GZF6IBWVLM5OZC4YINYL4O52RADJ6PSOSVIKSXT7JXKQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.228703612 (129h59m47.268276732s) [noise=true , address=77.90.31.11:4560 , piece_id=KOTB2RIVNIHV2FQUPNHCK6EHL7NYMAG3UAS4222KZLEV4IVEL4MQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.280036445 (129h59m47.319609565s) [noise=true , address=145.79.227.37:4591 , piece_id=UK6BCJMV5AOYGDY2CYUB3QEGU4T4R67KV4LUKZSO6KWWJ6H7U6QQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.298588774 (129h59m47.338161904s) [noise=true , address=45.91.116.6:4981 , piece_id=4C7UPWLLER6FS3R2SCTPFEMQYEBAQW4BUTIKHV33NAOROHBV5VMQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421743696 (129h59m47.461316817s) [noise=true , address=145.79.227.10:4424 , piece_id=JEF7EUNIGYZCZZSHN24UW6IXQZZQP3AZ5UMJRBGF3W2SXD3RYYIQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: <nil> Sep 11 23:28:11.421769185 (129h59m47.461342305s) [seg_pos={0 0}, upload=114431]: Segment reached optimal threshold of 14 pieces. Sep 11 23:28:11.421901909 (129h59m47.461475039s) [noise=true , address=145.79.227.5:4250 , piece_id=6NAKMMYQG46LJYXACJMDQ4VPATN7PU5QASXHRJGEDNBT7ZE6H7ZQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uoGjfqBLfoNrg2X1aYKYLKQjgFUnzLjHetCFc9sPjJa2qqKYM): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422002602 (129h59m47.461575722s) [noise=true , address=145.79.227.52:4459 , piece_id=CMDNLT6AYA6MEQ3YTTOTPVE6NVIWYERBZCGRTMSCVAFRXHUH5BSQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422079450 (129h59m47.46165257s) [noise=true , address=145.79.227.26:4686 , piece_id=XFZDLT4NQC2XS7SMTTEV2RRAUYDRVVPK2AO5HLVBR32IRL2UEEJQ, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U61X2oPRJjzWTuGEXqjModoHVsXvmjsPbftqGAfE5ff62Yzpp): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422124445 (129h59m47.461697565s) [noise=true , address=77.90.31.17:4785 , piece_id=VPL4SHGWVPNRORCDCP6KLWI37MXDHWHXYVOYJWKTEQP66SHJGQ4Q, seg_pos={0 0}, upload=114431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9AKP1rxpVvkxDs6XH2S6hR8DRHBZkWMZiYPTcZZjMZwLAaBN): protocol: expected piece hash; context canceled; EOF Sep 11 23:28:11.422136930 (129h59m47.46171005s) [seg_pos={0 0}, upload=114431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 11 23:28:11.422241199 (129h59m47.461814319s) [upload=114431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 11 23:28:11.422245557 (129h59m47.461818677s) [upload=114431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 11 23:28:11.722848051 (129h59m47.762421171s) [upload=114431]: Done uploading segments... Sep 11 23:28:11.722867237 (129h59m47.762440357s) [upload=114431]: Upload finished. err: <nil> Duration: 1m0.001925496s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.545574371s FAIL (2025-09-11 22:37:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.545595671s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.459284692s FAIL (2025-09-11 22:37:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.459311203s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 6.073632047s FAIL (2025-09-11 22:35:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.073659108s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.X........................................................] duration: 6.01091909s FAIL (2025-09-11 22:34:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.010941423s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.X.X.......................................................] duration: 6.244731842s FAIL (2025-09-11 22:33:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.24476179s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [XX.X.X......................................................] duration: 6.197226415s FAIL (2025-09-11 22:32:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.197251925s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.XX.X.X.....................................................] duration: 6.160236476s FAIL (2025-09-11 22:32:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.160259231s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.XX.X.X....................................................] duration: 6.156223257s FAIL (2025-09-11 22:31:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.156262893s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.XX.X.X...................................................] duration: 5.904453136s FAIL (2025-09-11 22:31:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.904514143s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [X.X.XX.X.X..................................................] duration: 6.095517912s FAIL (2025-09-11 22:30:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.095541467s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [XX.X.XX.X.X.................................................] duration: 6.362042187s FAIL (2025-09-11 22:29:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.362066794s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.XX.X.XX.X.X................................................] duration: 6.263343794s FAIL (2025-09-11 22:29:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.263372479s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 7.075279651s FAIL (2025-09-11 22:28:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ad=112943]: Uploading piece... Sep 11 21:45:22.824507134 (128h16m58.864080264s) [noise=true , address=45.91.116.7:4011 , piece_id=5GFDLPPJWV3BTJWWPQP3RGCU5FEJYUDZRXH4UPYZBP7FWPXQPQ3A, seg_pos={0 0}, upload=112943]: Uploading piece... Sep 11 21:45:22.824605302 (128h16m58.864178422s) [noise=true , address=77.90.31.12:4590 , piece_id=XT2SEA6PAMTB2RXQZ562B6CSE6F7DKIRDQOX2IOKFKPZWVJLTMPQ, seg_pos={0 0}, upload=112943]: Uploading piece... Sep 11 21:45:22.824866521 (128h16m58.864439641s) [noise=true , address=145.79.227.14:4838 , piece_id=HIBD33RCLTVCMYINWSECN3L6RXUWJLP6NCPF3MVVZ72QRERLUPKA, seg_pos={0 0}, upload=112943]: Uploading piece... Sep 11 21:45:22.825039191 (128h16m58.864612321s) [noise=true , address=77.90.31.18:4805 , piece_id=SKM4QNUIPVEQLBUNTMGXHL6LXZNR5NJZKCL5AA4XQCRJWLMVQABQ, seg_pos={0 0}, upload=112943]: Uploading piece... Sep 11 21:45:22.825156136 (128h16m58.864729256s) [noise=true , address=77.90.31.13:4626 , piece_id=AZ4LBSJUFIKJGGEWZID3BBFH2A5ZNJFTYFVKEL22T5NP5PZQVHKQ, seg_pos={0 0}, upload=112943]: Uploading piece... Sep 11 21:45:22.825514712 (128h16m58.865087832s) [noise=true , address=145.79.227.6:4258 , piece_id=WL2MXQNGWOCPWEUI2WPLUPKGBBLCVEPVBBPIZYS3AN7YNDQXR5UQ, seg_pos={0 0}, upload=112943]: Uploading piece... Sep 11 21:45:30.426993846 (128h17m6.466566966s) [upload=112943]: Next returned nil segment Sep 11 21:45:30.427011269 (128h17m6.466584389s) [upload=112943]: Waiting for error group managing segments... Sep 11 21:45:31.886328590 (128h17m7.92590171s) [noise=true , address=145.79.227.15:4875 , piece_id=ZDQG2DEZON4YQSHU2EVD2ZJCEWIWGKV6CAI4KC23W4CXIQYX6IEA, seg_pos={0 0}, upload=112943]: Done uploading piece. err: <nil> Sep 11 21:45:34.621761394 (128h17m10.661334534s) [noise=true , address=145.79.227.14:4840 , piece_id=AB4E2UMIF6TANFI7ZHT3CXK2NACPXKPCRKRMCV3UKS6DZWN2F4MQ, seg_pos={0 0}, upload=112943]: Done uploading piece. err: <nil> Sep 11 21:45:34.752049114 (128h17m10.791622234s) [noise=true , address=145.79.227.14:4838 , piece_id=HIBD33RCLTVCMYINWSECN3L6RXUWJLP6NCPF3MVVZ72QRERLUPKA, seg_pos={0 0}, upload=112943]: Done uploading piece. err: <nil> Sep 11 21:45:38.515075056 (128h17m14.554648176s) [noise=true , address=145.79.227.6:4258 , piece_id=WL2MXQNGWOCPWEUI2WPLUPKGBBLCVEPVBBPIZYS3AN7YNDQXR5UQ, seg_pos={0 0}, upload=112943]: Done uploading piece. err: <nil> Sep 11 21:45:51.839239169 (128h17m27.878812289s) [noise=true , address=77.90.31.12:4590 , piece_id=XT2SEA6PAMTB2RXQZ562B6CSE6F7DKIRDQOX2IOKFKPZWVJLTMPQ, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 188.166.225.170:60898->77.90.31.12:4590: use of closed network connection; write tcp 188.166.225.170:60898->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60898->77.90.31.12:4590: use of closed network connection Sep 11 21:45:51.839290628 (128h17m27.878863748s) [noise=true , address=77.90.31.13:4626 , piece_id=AZ4LBSJUFIKJGGEWZID3BBFH2A5ZNJFTYFVKEL22T5NP5PZQVHKQ, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:36744->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:36744->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36744->77.90.31.13:4626: use of closed network connection Sep 11 21:45:51.839313892 (128h17m27.878887012s) [noise=true , address=77.90.31.19:4841 , piece_id=4UI3RBNNVMJJ5MHB6KC5U53T6ICTG4H5TY3JYTZOXL6ZIHTCC6QA, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:34764->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:34764->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34764->77.90.31.19:4841: use of closed network connection Sep 11 21:45:51.839347336 (128h17m27.878920456s) [noise=true , address=77.90.31.17:4771 , piece_id=CETFLJ57N7Q4DMD6MHO2DIKRWQB3JAISLBTPS5ZORFQ5VPX6ECEA, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:35714->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:35714->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35714->77.90.31.17:4771: use of closed network connection Sep 11 21:45:51.839369308 (128h17m27.878942428s) [noise=true , address=45.91.116.9:4263 , piece_id=AJ6I6CYZ2KQF6HCSOGHWUP5FXZAB5RDJWLWD5CXX2YHYFOBG2M6Q, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 188.166.225.170:52730->45.91.116.9:4263: use of closed network connection; write tcp 188.166.225.170:52730->45.91.116.9:4263: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52730->45.91.116.9:4263: use of closed network connection Sep 11 21:45:51.839388404 (128h17m27.878961524s) [noise=true , address=45.91.116.14:4189 , piece_id=Q5NI3PHHL7KC2NEKFWM3NZTEECUYIQJVQV4W2BSMNGL7ZHD6LXDA, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:56508->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:56508->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56508->45.91.116.14:4189: use of closed network connection Sep 11 21:45:51.839435334 (128h17m27.879008454s) [noise=true , address=77.90.31.18:4805 , piece_id=SKM4QNUIPVEQLBUNTMGXHL6LXZNR5NJZKCL5AA4XQCRJWLMVQABQ, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:42682->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:42682->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42682->77.90.31.18:4805: use of closed network connection Sep 11 21:45:51.839467916 (128h17m27.879041036s) [noise=true , address=77.90.31.13:4627 , piece_id=3RJEOY3VN5CRRSYCIXJTQNILLWYWY2NP4MNM5XWTLHBJCSV5M6DQ, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:34172->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:34172->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34172->77.90.31.13:4627: use of closed network connection Sep 11 21:45:51.839491592 (128h17m27.879064712s) [noise=true , address=45.91.116.6:4974 , piece_id=D3YQAOV7GEDLDD5HGVQVMSIXZFO6FWFRU7ZIF4WYKDLS7PFM6CQA, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 188.166.225.170:35664->45.91.116.6:4974: use of closed network connection; write tcp 188.166.225.170:35664->45.91.116.6:4974: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35664->45.91.116.6:4974: use of closed network connection Sep 11 21:45:51.839515037 (128h17m27.879088147s) [noise=true , address=77.90.31.14:4661 , piece_id=JIXUJTY3K6QCX3KY7NNF5MGWWXU43VOZWTSCCNAJLTVUMCSZILHQ, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:34684->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:34684->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34684->77.90.31.14:4661: use of closed network connection Sep 11 21:45:51.839553540 (128h17m27.87912666s) [noise=true , address=45.91.116.10:4081 , piece_id=N55XNI7WTWWFQCXRWTNN6HVSMWJJKOBIIQLU5J2NEUKJF5AKEQOA, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 188.166.225.170:43708->45.91.116.10:4081: use of closed network connection; write tcp 188.166.225.170:43708->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43708->45.91.116.10:4081: use of closed network connection Sep 11 21:45:51.839597715 (128h17m27.879170835s) [noise=true , address=45.91.116.7:4011 , piece_id=5GFDLPPJWV3BTJWWPQP3RGCU5FEJYUDZRXH4UPYZBP7FWPXQPQ3A, seg_pos={0 0}, upload=112943]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:54544->45.91.116.7:4011: use of closed network connection; context deadline exceeded Sep 11 21:45:51.839619447 (128h17m27.879192567s) [seg_pos={0 0}, upload=112943]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Sep 11 21:45:52.089432283 (128h17m28.129005403s) [upload=112943]: Done uploading segments... Sep 11 21:45:52.089457251 (128h17m28.129030371s) [upload=112943]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 7.075308056s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)