Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.688270526s trace: https://jaeger.dev.storj.io/trace/4d1271690c1812c7 FAIL (2025-12-01 08:59:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 311903349 (528h50m34.863373811s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312472513 (528h50m34.863942974s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312694586 (528h50m34.864165047s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313082044 (528h50m34.864552505s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313512714 (528h50m34.864983165s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313873221 (528h50m34.865343682s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314219831 (528h50m34.865690292s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314231202 (528h50m34.865701653s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314736073 (528h50m34.866206534s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314938228 (528h50m34.866408689s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315052687 (528h50m34.866523148s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315330937 (528h50m34.866801398s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315496792 (528h50m34.866967253s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.316085192 (528h50m34.867555653s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318178268 (528h50m34.869648729s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318895824 (528h50m34.870366286s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.319343858 (528h50m34.870814309s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:37.643563451 (528h50m36.195033902s) [upload=465737]: Next returned nil segment Dec 1 08:54:37.643578420 (528h50m36.195048871s) [upload=465737]: Waiting for error group managing segments... Dec 1 08:54:37.994028340 (528h50m36.545498791s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:37.995634548 (528h50m36.547104999s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.048667453 (528h50m36.600137914s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199096407 (528h50m36.750566858s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199112156 (528h50m36.750582617s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.210165524 (528h50m36.761635985s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.222289150 (528h50m36.773759611s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.235518601 (528h50m36.786989052s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.236378288 (528h50m36.787848749s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.237735913 (528h50m36.789206374s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.245936348 (528h50m36.797406819s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.280662262 (528h50m36.832132723s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.290789146 (528h50m36.842259617s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292112646 (528h50m36.843583117s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292126513 (528h50m36.843596994s) [seg_pos={0 0}, upload=465737]: Segment reached optimal threshold of 14 pieces. Dec 1 08:54:38.292349597 (528h50m36.843820068s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292358304 (528h50m36.843828785s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292589174 (528h50m36.844059655s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292596086 (528h50m36.844066538s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292738588 (528h50m36.844209069s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292747586 (528h50m36.844218047s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292895687 (528h50m36.844366168s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YWmyb9dcfFj82ShgsB6EnQXm3mx1YSLvWc6P1SZhREksqXUUH): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292903362 (528h50m36.844373813s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292919283 (528h50m36.844389754s) [seg_pos={0 0}, upload=465737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 1 08:54:38.292994416 (528h50m36.844464887s) [upload=465737]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 1 08:54:38.292999395 (528h50m36.844469856s) [upload=465737]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 1 08:54:38.589450511 (528h50m37.140920982s) [upload=465737]: Done uploading segments... Dec 1 08:54:38.589476390 (528h50m37.140946851s) [upload=465737]: Upload finished. err: <nil> Duration: 5.688315862s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.699798017s trace: https://jaeger.dev.storj.io/trace/4d1271690c1812c7 FAIL (2025-12-01 08:58:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 311903349 (528h50m34.863373811s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312472513 (528h50m34.863942974s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312694586 (528h50m34.864165047s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313082044 (528h50m34.864552505s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313512714 (528h50m34.864983165s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313873221 (528h50m34.865343682s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314219831 (528h50m34.865690292s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314231202 (528h50m34.865701653s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314736073 (528h50m34.866206534s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314938228 (528h50m34.866408689s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315052687 (528h50m34.866523148s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315330937 (528h50m34.866801398s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315496792 (528h50m34.866967253s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.316085192 (528h50m34.867555653s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318178268 (528h50m34.869648729s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318895824 (528h50m34.870366286s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.319343858 (528h50m34.870814309s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:37.643563451 (528h50m36.195033902s) [upload=465737]: Next returned nil segment Dec 1 08:54:37.643578420 (528h50m36.195048871s) [upload=465737]: Waiting for error group managing segments... Dec 1 08:54:37.994028340 (528h50m36.545498791s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:37.995634548 (528h50m36.547104999s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.048667453 (528h50m36.600137914s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199096407 (528h50m36.750566858s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199112156 (528h50m36.750582617s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.210165524 (528h50m36.761635985s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.222289150 (528h50m36.773759611s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.235518601 (528h50m36.786989052s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.236378288 (528h50m36.787848749s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.237735913 (528h50m36.789206374s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.245936348 (528h50m36.797406819s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.280662262 (528h50m36.832132723s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.290789146 (528h50m36.842259617s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292112646 (528h50m36.843583117s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292126513 (528h50m36.843596994s) [seg_pos={0 0}, upload=465737]: Segment reached optimal threshold of 14 pieces. Dec 1 08:54:38.292349597 (528h50m36.843820068s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292358304 (528h50m36.843828785s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292589174 (528h50m36.844059655s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292596086 (528h50m36.844066538s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292738588 (528h50m36.844209069s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292747586 (528h50m36.844218047s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292895687 (528h50m36.844366168s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YWmyb9dcfFj82ShgsB6EnQXm3mx1YSLvWc6P1SZhREksqXUUH): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292903362 (528h50m36.844373813s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292919283 (528h50m36.844389754s) [seg_pos={0 0}, upload=465737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 1 08:54:38.292994416 (528h50m36.844464887s) [upload=465737]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 1 08:54:38.292999395 (528h50m36.844469856s) [upload=465737]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 1 08:54:38.589450511 (528h50m37.140920982s) [upload=465737]: Done uploading segments... Dec 1 08:54:38.589476390 (528h50m37.140946851s) [upload=465737]: Upload finished. err: <nil> Duration: 5.699825198s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.601363553s trace: https://jaeger.dev.storj.io/trace/4d1271690c1812c7 FAIL (2025-12-01 08:57:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 311903349 (528h50m34.863373811s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312472513 (528h50m34.863942974s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312694586 (528h50m34.864165047s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313082044 (528h50m34.864552505s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313512714 (528h50m34.864983165s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313873221 (528h50m34.865343682s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314219831 (528h50m34.865690292s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314231202 (528h50m34.865701653s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314736073 (528h50m34.866206534s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314938228 (528h50m34.866408689s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315052687 (528h50m34.866523148s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315330937 (528h50m34.866801398s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315496792 (528h50m34.866967253s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.316085192 (528h50m34.867555653s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318178268 (528h50m34.869648729s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318895824 (528h50m34.870366286s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.319343858 (528h50m34.870814309s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:37.643563451 (528h50m36.195033902s) [upload=465737]: Next returned nil segment Dec 1 08:54:37.643578420 (528h50m36.195048871s) [upload=465737]: Waiting for error group managing segments... Dec 1 08:54:37.994028340 (528h50m36.545498791s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:37.995634548 (528h50m36.547104999s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.048667453 (528h50m36.600137914s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199096407 (528h50m36.750566858s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199112156 (528h50m36.750582617s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.210165524 (528h50m36.761635985s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.222289150 (528h50m36.773759611s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.235518601 (528h50m36.786989052s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.236378288 (528h50m36.787848749s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.237735913 (528h50m36.789206374s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.245936348 (528h50m36.797406819s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.280662262 (528h50m36.832132723s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.290789146 (528h50m36.842259617s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292112646 (528h50m36.843583117s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292126513 (528h50m36.843596994s) [seg_pos={0 0}, upload=465737]: Segment reached optimal threshold of 14 pieces. Dec 1 08:54:38.292349597 (528h50m36.843820068s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292358304 (528h50m36.843828785s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292589174 (528h50m36.844059655s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292596086 (528h50m36.844066538s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292738588 (528h50m36.844209069s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292747586 (528h50m36.844218047s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292895687 (528h50m36.844366168s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YWmyb9dcfFj82ShgsB6EnQXm3mx1YSLvWc6P1SZhREksqXUUH): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292903362 (528h50m36.844373813s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292919283 (528h50m36.844389754s) [seg_pos={0 0}, upload=465737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 1 08:54:38.292994416 (528h50m36.844464887s) [upload=465737]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 1 08:54:38.292999395 (528h50m36.844469856s) [upload=465737]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 1 08:54:38.589450511 (528h50m37.140920982s) [upload=465737]: Done uploading segments... Dec 1 08:54:38.589476390 (528h50m37.140946851s) [upload=465737]: Upload finished. err: <nil> Duration: 5.601385756s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.627761285s trace: https://jaeger.dev.storj.io/trace/4d1271690c1812c7 FAIL (2025-12-01 08:56:36 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 311903349 (528h50m34.863373811s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312472513 (528h50m34.863942974s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312694586 (528h50m34.864165047s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313082044 (528h50m34.864552505s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313512714 (528h50m34.864983165s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313873221 (528h50m34.865343682s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314219831 (528h50m34.865690292s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314231202 (528h50m34.865701653s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314736073 (528h50m34.866206534s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314938228 (528h50m34.866408689s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315052687 (528h50m34.866523148s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315330937 (528h50m34.866801398s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315496792 (528h50m34.866967253s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.316085192 (528h50m34.867555653s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318178268 (528h50m34.869648729s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318895824 (528h50m34.870366286s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.319343858 (528h50m34.870814309s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:37.643563451 (528h50m36.195033902s) [upload=465737]: Next returned nil segment Dec 1 08:54:37.643578420 (528h50m36.195048871s) [upload=465737]: Waiting for error group managing segments... Dec 1 08:54:37.994028340 (528h50m36.545498791s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:37.995634548 (528h50m36.547104999s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.048667453 (528h50m36.600137914s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199096407 (528h50m36.750566858s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199112156 (528h50m36.750582617s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.210165524 (528h50m36.761635985s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.222289150 (528h50m36.773759611s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.235518601 (528h50m36.786989052s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.236378288 (528h50m36.787848749s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.237735913 (528h50m36.789206374s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.245936348 (528h50m36.797406819s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.280662262 (528h50m36.832132723s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.290789146 (528h50m36.842259617s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292112646 (528h50m36.843583117s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292126513 (528h50m36.843596994s) [seg_pos={0 0}, upload=465737]: Segment reached optimal threshold of 14 pieces. Dec 1 08:54:38.292349597 (528h50m36.843820068s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292358304 (528h50m36.843828785s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292589174 (528h50m36.844059655s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292596086 (528h50m36.844066538s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292738588 (528h50m36.844209069s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292747586 (528h50m36.844218047s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292895687 (528h50m36.844366168s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YWmyb9dcfFj82ShgsB6EnQXm3mx1YSLvWc6P1SZhREksqXUUH): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292903362 (528h50m36.844373813s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292919283 (528h50m36.844389754s) [seg_pos={0 0}, upload=465737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 1 08:54:38.292994416 (528h50m36.844464887s) [upload=465737]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 1 08:54:38.292999395 (528h50m36.844469856s) [upload=465737]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 1 08:54:38.589450511 (528h50m37.140920982s) [upload=465737]: Done uploading segments... Dec 1 08:54:38.589476390 (528h50m37.140946851s) [upload=465737]: Upload finished. err: <nil> Duration: 5.62779002s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.69843497s trace: https://jaeger.dev.storj.io/trace/4d1271690c1812c7 FAIL (2025-12-01 08:56:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 311903349 (528h50m34.863373811s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312472513 (528h50m34.863942974s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312694586 (528h50m34.864165047s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313082044 (528h50m34.864552505s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313512714 (528h50m34.864983165s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313873221 (528h50m34.865343682s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314219831 (528h50m34.865690292s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314231202 (528h50m34.865701653s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314736073 (528h50m34.866206534s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314938228 (528h50m34.866408689s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315052687 (528h50m34.866523148s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315330937 (528h50m34.866801398s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315496792 (528h50m34.866967253s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.316085192 (528h50m34.867555653s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318178268 (528h50m34.869648729s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318895824 (528h50m34.870366286s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.319343858 (528h50m34.870814309s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:37.643563451 (528h50m36.195033902s) [upload=465737]: Next returned nil segment Dec 1 08:54:37.643578420 (528h50m36.195048871s) [upload=465737]: Waiting for error group managing segments... Dec 1 08:54:37.994028340 (528h50m36.545498791s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:37.995634548 (528h50m36.547104999s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.048667453 (528h50m36.600137914s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199096407 (528h50m36.750566858s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199112156 (528h50m36.750582617s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.210165524 (528h50m36.761635985s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.222289150 (528h50m36.773759611s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.235518601 (528h50m36.786989052s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.236378288 (528h50m36.787848749s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.237735913 (528h50m36.789206374s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.245936348 (528h50m36.797406819s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.280662262 (528h50m36.832132723s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.290789146 (528h50m36.842259617s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292112646 (528h50m36.843583117s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292126513 (528h50m36.843596994s) [seg_pos={0 0}, upload=465737]: Segment reached optimal threshold of 14 pieces. Dec 1 08:54:38.292349597 (528h50m36.843820068s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292358304 (528h50m36.843828785s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292589174 (528h50m36.844059655s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292596086 (528h50m36.844066538s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292738588 (528h50m36.844209069s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292747586 (528h50m36.844218047s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292895687 (528h50m36.844366168s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YWmyb9dcfFj82ShgsB6EnQXm3mx1YSLvWc6P1SZhREksqXUUH): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292903362 (528h50m36.844373813s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292919283 (528h50m36.844389754s) [seg_pos={0 0}, upload=465737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 1 08:54:38.292994416 (528h50m36.844464887s) [upload=465737]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 1 08:54:38.292999395 (528h50m36.844469856s) [upload=465737]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 1 08:54:38.589450511 (528h50m37.140920982s) [upload=465737]: Done uploading segments... Dec 1 08:54:38.589476390 (528h50m37.140946851s) [upload=465737]: Upload finished. err: <nil> Duration: 5.698606508s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.742167366s trace: https://jaeger.dev.storj.io/trace/4d1271690c1812c7 FAIL (2025-12-01 08:55:47 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 311903349 (528h50m34.863373811s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312472513 (528h50m34.863942974s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312694586 (528h50m34.864165047s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313082044 (528h50m34.864552505s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313512714 (528h50m34.864983165s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313873221 (528h50m34.865343682s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314219831 (528h50m34.865690292s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314231202 (528h50m34.865701653s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314736073 (528h50m34.866206534s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314938228 (528h50m34.866408689s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315052687 (528h50m34.866523148s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315330937 (528h50m34.866801398s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315496792 (528h50m34.866967253s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.316085192 (528h50m34.867555653s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318178268 (528h50m34.869648729s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318895824 (528h50m34.870366286s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.319343858 (528h50m34.870814309s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:37.643563451 (528h50m36.195033902s) [upload=465737]: Next returned nil segment Dec 1 08:54:37.643578420 (528h50m36.195048871s) [upload=465737]: Waiting for error group managing segments... Dec 1 08:54:37.994028340 (528h50m36.545498791s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:37.995634548 (528h50m36.547104999s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.048667453 (528h50m36.600137914s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199096407 (528h50m36.750566858s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199112156 (528h50m36.750582617s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.210165524 (528h50m36.761635985s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.222289150 (528h50m36.773759611s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.235518601 (528h50m36.786989052s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.236378288 (528h50m36.787848749s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.237735913 (528h50m36.789206374s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.245936348 (528h50m36.797406819s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.280662262 (528h50m36.832132723s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.290789146 (528h50m36.842259617s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292112646 (528h50m36.843583117s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292126513 (528h50m36.843596994s) [seg_pos={0 0}, upload=465737]: Segment reached optimal threshold of 14 pieces. Dec 1 08:54:38.292349597 (528h50m36.843820068s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292358304 (528h50m36.843828785s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292589174 (528h50m36.844059655s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292596086 (528h50m36.844066538s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292738588 (528h50m36.844209069s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292747586 (528h50m36.844218047s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292895687 (528h50m36.844366168s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YWmyb9dcfFj82ShgsB6EnQXm3mx1YSLvWc6P1SZhREksqXUUH): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292903362 (528h50m36.844373813s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292919283 (528h50m36.844389754s) [seg_pos={0 0}, upload=465737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 1 08:54:38.292994416 (528h50m36.844464887s) [upload=465737]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 1 08:54:38.292999395 (528h50m36.844469856s) [upload=465737]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 1 08:54:38.589450511 (528h50m37.140920982s) [upload=465737]: Done uploading segments... Dec 1 08:54:38.589476390 (528h50m37.140946851s) [upload=465737]: Upload finished. err: <nil> Duration: 5.74219503s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.003424667s trace: https://jaeger.dev.storj.io/trace/4d1271690c1812c7 FAIL (2025-12-01 08:55:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 311903349 (528h50m34.863373811s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312472513 (528h50m34.863942974s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.312694586 (528h50m34.864165047s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313082044 (528h50m34.864552505s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313512714 (528h50m34.864983165s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.313873221 (528h50m34.865343682s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314219831 (528h50m34.865690292s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314231202 (528h50m34.865701653s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314736073 (528h50m34.866206534s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.314938228 (528h50m34.866408689s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315052687 (528h50m34.866523148s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315330937 (528h50m34.866801398s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.315496792 (528h50m34.866967253s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.316085192 (528h50m34.867555653s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318178268 (528h50m34.869648729s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.318895824 (528h50m34.870366286s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:36.319343858 (528h50m34.870814309s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Uploading piece... Dec 1 08:54:37.643563451 (528h50m36.195033902s) [upload=465737]: Next returned nil segment Dec 1 08:54:37.643578420 (528h50m36.195048871s) [upload=465737]: Waiting for error group managing segments... Dec 1 08:54:37.994028340 (528h50m36.545498791s) [noise=true , address=64.49.13.137:4501 , piece_id=GM4ZLBDFMOAMOVUPYPKNDYQSTGUHXANOPUFH5EZNKY7HZB2FMZQA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:37.995634548 (528h50m36.547104999s) [noise=true , address=64.49.13.140:4516 , piece_id=PUJ5PXHBX3SXT5IYU6GOTFRUXYFPLXN5V2DAZ57I5KHVAJ7N5RKA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.048667453 (528h50m36.600137914s) [noise=true , address=64.49.13.138:4488 , piece_id=7AA4UOUWT3R5YWQQYTFOMB2DHDBTF3NXG7E6ITUTEERZ7XQ5BF4A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199096407 (528h50m36.750566858s) [noise=true , address=145.79.227.9:4372 , piece_id=PK7K4TJFIWVVJ53I6PUAYOAPNJQXXOZTCLYH7M3CL6AOF7MMJRFQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.199112156 (528h50m36.750582617s) [noise=true , address=45.91.116.5:4309 , piece_id=KLL2M475QWZYAFE627G4II76CXFBXE7RDN34U7YFFUY7GKKTLDSA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.210165524 (528h50m36.761635985s) [noise=true , address=145.79.227.39:4031 , piece_id=2AAJCUZLXXTSA7ZIUCHFOPT6EAAP7OSKQQNEMTVPZRAK2T7JL2PQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.222289150 (528h50m36.773759611s) [noise=true , address=145.79.227.17:4981 , piece_id=RCD7IQ7UGK5SMFNFNSSCSHFHYPSQZEBLHKW63NEKZKNMYC5ZJIMQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.235518601 (528h50m36.786989052s) [noise=true , address=77.90.31.15:4703 , piece_id=23EQNMS5PCIXVFUHRPVSACTGMLEBUT33FAU5LBWAJYC7V27XVWIQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.236378288 (528h50m36.787848749s) [noise=true , address=77.90.31.12:4605 , piece_id=RNQPT3LKJOGA3EZE3BJIVP4JNBK6N2VJVGNIJINNSKR2MID3SHZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.237735913 (528h50m36.789206374s) [noise=true , address=77.90.31.18:4825 , piece_id=LQEMH52QI6E2CFS57ROBGGJ2CTYBJXBKXKR3UUIOZ7GKLOARCG5A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.245936348 (528h50m36.797406819s) [noise=true , address=145.79.227.19:4099 , piece_id=XJYHE5HRJPQL7GIPPXIVDAUHVQGL2MTV7BIDY3IIZECTJIX5VJ7Q, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.280662262 (528h50m36.832132723s) [noise=true , address=45.91.116.6:4997 , piece_id=BCLQT6NCFKKCK2B4EQEJCSHACEJPX7JOTX354LYZKRM76JVL5RZQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.290789146 (528h50m36.842259617s) [noise=true , address=45.91.116.12:4251 , piece_id=NM6OAXIHFVP367JVCWRI63HVE5BC4NOV7TGB6J6EE2JXU5SPVMEQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292112646 (528h50m36.843583117s) [noise=true , address=77.90.31.13:4637 , piece_id=B72FJN7EIHBC2SQ7ZXATHNYMOI2ZQ53YL5E4J5JHPMHMXQQWMEAA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: <nil> Dec 1 08:54:38.292126513 (528h50m36.843596994s) [seg_pos={0 0}, upload=465737]: Segment reached optimal threshold of 14 pieces. Dec 1 08:54:38.292349597 (528h50m36.843820068s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292358304 (528h50m36.843828785s) [noise=true , address=64.49.13.169:4711 , piece_id=6W57OCVULI2XBHYH6H3LQ6MM6SKG6GSSWBPGZZ2ADRLHL5LQKWWQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292589174 (528h50m36.844059655s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292596086 (528h50m36.844066538s) [noise=true , address=45.91.116.11:4141 , piece_id=QFOPOZ2MWCIXENU3BD73RKQ4OPJ6JPZY7QVXCGOH7XUY2UM7NHCA, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292738588 (528h50m36.844209069s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iQ1hDK2j81J8RpWCFQ8uGk8aPgU5AVJAMdTbstBAA5E6QcqAp): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292747586 (528h50m36.844218047s) [noise=true , address=45.91.116.13:4167 , piece_id=TRKEUI3YEAXAGNFMHBQBGRCOL36ZVR3LAYBDZFCPMHQCQ2Q4YDYQ, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292895687 (528h50m36.844366168s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YWmyb9dcfFj82ShgsB6EnQXm3mx1YSLvWc6P1SZhREksqXUUH): protocol: expected piece hash; context canceled; EOF Dec 1 08:54:38.292903362 (528h50m36.844373813s) [noise=true , address=77.90.31.11:4560 , piece_id=GVMHOMA273OOGL2HRQ6O53YCBVHCMLM2QQPSHATA6XEAX7LSRM7A, seg_pos={0 0}, upload=465737]: Long tail cancellation due to optimal threshold Dec 1 08:54:38.292919283 (528h50m36.844389754s) [seg_pos={0 0}, upload=465737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Dec 1 08:54:38.292994416 (528h50m36.844464887s) [upload=465737]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 1 08:54:38.292999395 (528h50m36.844469856s) [upload=465737]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 1 08:54:38.589450511 (528h50m37.140920982s) [upload=465737]: Done uploading segments... Dec 1 08:54:38.589476390 (528h50m37.140946851s) [upload=465737]: Upload finished. err: <nil> Duration: 1m0.003512665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.180509176s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:49:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.180539492s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.049730545s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:49:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.049832318s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.024190402s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:48:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.024219797s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 4.975511859s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:47:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.975663498s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.128788227s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:47:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.12882136s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.217776859s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:47:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.217806194s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.247334389s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:46:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.247365348s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 4.996405582s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:45:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.996441501s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.129735971s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:44:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.129763061s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 4.976822399s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:43:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.976854358s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.818477778s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:42:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.818511061s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.089277238s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:42:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.089308446s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.192833232s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:41:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.192913604s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.029911635s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:40:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.030035299s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.115578598s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:39:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.115614928s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.203269773s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:38:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.203297997s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.129096414s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:38:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.129140697s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.987111176s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:37:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.98713929s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.21480056s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:36:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.214827512s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.9828167s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:36:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.982860342s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.027630921s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:35:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.027662461s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.108384279s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:34:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.108435616s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.091926739s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:33:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.091956735s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.108303766s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:33:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.108343812s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.099804271s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:32:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.099829718s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 4.845409924s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:31:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.845484657s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.068102196s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:30:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.068136281s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.40912529s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:30:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.409200863s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.013247162s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:29:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.01330906s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.986233343s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:29:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.986253912s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.283901378s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:28:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.283931495s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.120575164s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:28:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.120608849s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.123925019s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:27:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.123956579s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.162166512s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:26:36 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.16220291s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.215042738s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:25:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.215068707s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.225229215s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:25:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.225264602s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.895759323s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:24:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.895795002s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.985564638s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:23:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.985594305s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.969964233s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:23:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.969991124s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.951596958s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:23:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.951635001s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.052550121s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:21:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.052599906s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.083220533s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:20:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.083252554s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.201960125s trace: https://jaeger.dev.storj.io/trace/16da76229b79d6b7 FAIL (2025-12-01 05:20:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.202005862s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)