Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 10.226745267s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:12:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 10.226759354s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 10.209932936s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:10:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 10.20995572s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.07235934s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:09:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 6.072377535s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.325911817s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:08:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 6.325937005s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 8.059761384s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:08:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 8.059787004s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 9.958189903s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:07:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 9.95821333s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 7.05361549s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:06:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 7.053631591s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 29.488738439s trace: https://jaeger.dev.storj.io/trace/2f9c89da71fb2653 FAIL (2026-05-19 07:06:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== May 19 07:06:17.868412334 (444h18m28.389236079s) [upload=426069]: Starting upload May 19 07:06:17.868501894 (444h18m28.38932564s) [upload=426069]: Done starting upload May 19 07:06:17.868575464 (444h18m28.389399209s) [upload=426069]: Uploading segments... May 19 07:06:17.868675946 (444h18m28.389499681s) [upload=426069]: Got next segment. Inline: false May 19 07:06:17.868701916 (444h18m28.389525651s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 07:06:17.868705703 (444h18m28.389529448s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 07:06:18.103595758 (444h18m28.624419553s) [seg_pos={0 0}, upload=426069]: Begin upload segment... May 19 07:06:18.103684477 (444h18m28.624508232s) [seg_pos={0 0}, upload=426069]: Done begin upload segment. May 19 07:06:18.103704675 (444h18m28.62452846s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103723541 (444h18m28.624547286s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.103799176 (444h18m28.624622921s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.104569415 (444h18m28.62539317s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105203325 (444h18m28.62602709s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.105707537 (444h18m28.626531292s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106188996 (444h18m28.627012751s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.106619958 (444h18m28.627443713s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107018649 (444h18m28.627842394s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107392162 (444h18m28.628215907s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.107826100 (444h18m28.628649845s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108249318 (444h18m28.629073063s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.108672696 (444h18m28.629496441s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.109100352 (444h18m28.629924097s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.110467149 (444h18m28.631290894s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:18.113835036 (444h18m28.634658781s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Uploading piece... May 19 07:06:19.407046757 (444h18m29.927870502s) [upload=426069]: Next returned nil segment May 19 07:06:19.407061995 (444h18m29.92788575s) [upload=426069]: Waiting for error group managing segments... May 19 07:06:19.743341599 (444h18m30.264165344s) [noise=true , address=193.149.164.78:4493 , piece_id=XMDDEPLGBL77VWLZWWWJQV74EYSYIM2NRMYBVXUO2CRJYDLXOMOQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.809130538 (444h18m30.329954283s) [noise=true , address=167.17.72.71:4789 , piece_id=HT53M3PLV5AFA3NVSS4ANMVIMNZLN2LOSNAGUP4ZPAS6UDSRMSAQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.811837964 (444h18m30.332661709s) [noise=true , address=64.49.13.27:4968 , piece_id=VRMPLOPTOBJ3WHVBAF4GYHC6PJMSX44GGFWD2LG7BWZWTMGBQVUQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.827823707 (444h18m30.348647452s) [noise=true , address=167.17.72.69:4732 , piece_id=XVNBSPM7PG7PEXOVY6XXDTVYY4YU75FQD46HMLEXVYAXYP62YNLQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.939936329 (444h18m30.460760074s) [noise=true , address=167.17.72.68:4648 , piece_id=DAGXKC7IU3HLGM2VDHPLM76VTE37YALW5GNWCFDRK6VUTOFEXA2A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.987088334 (444h18m30.507912079s) [noise=true , address=145.79.227.29:4956 , piece_id=DTTABHU2RE37GC6FH74BL34ZKVFXEGPMBSXBMERCIAUB4GZVILJQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:19.999172874 (444h18m30.519996629s) [noise=true , address=145.79.227.19:4089 , piece_id=DFCZKDFUNGP4LFPNY3NFKYINGVIETGLDQHHDMQIKJPQDAI6P72PA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.003854748 (444h18m30.524678513s) [noise=true , address=145.79.227.5:4229 , piece_id=TS4G46IQVLFO2DZEYU2CX3QTHLVMYAPXYEWOFGRVIYNZKCLGVRLA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.023342103 (444h18m30.544165848s) [noise=true , address=145.79.227.6:4272 , piece_id=JIS3XOECJYPZ5RZD4B6UGFTPC4FRDNMK755TZDJQLZDJ7WCXNVEA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.053126598 (444h18m30.573950343s) [noise=true , address=145.79.227.21:4487 , piece_id=4OPEESLEJGUYPTLA6BGNVKEI4TOARYAFC3AQZ3XLICBGJFBQMA6A, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:20.300112894 (444h18m30.820936639s) [noise=true , address=193.149.164.67:4005 , piece_id=IJEIHGG2WZWRO2KTMOIBOVHF6I77ESHVTFPLDKBQ2K3KBIEGLJ7Q, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:21.904360007 (444h18m32.425183752s) [noise=true , address=45.91.116.10:4111 , piece_id=2QI2UFV2ILTCIIAMVNCJ6M5RY5FFNGUCIGJYLE4H5OTND6RTQMTA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.219801165 (444h18m33.74062491s) [noise=true , address=45.91.116.13:4184 , piece_id=F6NE7PAPBZBXRGL2ISVUYW6INISN37EI2QVDZI7V62BTYSQF4RPQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457213703 (444h18m33.978037438s) [noise=true , address=45.91.116.6:4003 , piece_id=LLPADLSGB2ITI2N6KJIQCGTBKYMOPXNMQIM4CKS5YWJNO6M3V5DA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: <nil> May 19 07:06:23.457232960 (444h18m33.978056705s) [seg_pos={0 0}, upload=426069]: Satisfied cohort requirements after 14 pieces May 19 07:06:23.457370442 (444h18m33.978194187s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Kg43gDX5Tybqk93Xg9F1rVzGjbDGJYrrkDUUK4Mepdu2iGYJm): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457378256 (444h18m33.978202001s) [noise=true , address=45.91.116.11:4122 , piece_id=PLUAQTIYUIPS756ASKYE5N2QARV2CVMOZUNNIN36SXSAGOPNV5LA, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457462808 (444h18m33.978286543s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CHPuJdsjXtHCho9WdqpSvzRbEJqmAXchTkhmXgVqWQTTTCrV3): protocol: expected piece hash; context canceled; EOF May 19 07:06:23.457467016 (444h18m33.978290761s) [noise=true , address=45.91.116.5:4309 , piece_id=D67UIM6KNXWA3ULLXFOVCNBFFOM5BBKV4YMLPO4X5ZMOKWCPEDBQ, seg_pos={0 0}, upload=426069]: Long tail cancellation due to optimal threshold May 19 07:06:23.457482957 (444h18m33.978306702s) [seg_pos={0 0}, upload=426069]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> May 19 07:06:23.457540466 (444h18m33.978364201s) [upload=426069]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 19 07:06:23.457544193 (444h18m33.978367928s) [upload=426069]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 19 07:06:23.736828300 (444h18m34.257652045s) [upload=426069]: Done uploading segments... May 19 07:06:23.736847335 (444h18m34.25767108s) [upload=426069]: Upload finished. err: <nil> Duration: 29.4887707s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 57.147626ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:11:33 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 57.171743ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 60.293779ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:11:10 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 60.316893ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 55.81749ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:10:44 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 55.840773ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 63.320385ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:09:54 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 63.346354ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 62.073244ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:09:35 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 62.092682ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 73.936863ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:08:41 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 73.95154ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 69.895641ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:07:39 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 69.922183ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 72.407114ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:06:27 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 72.428875ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 65.052511ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:05:45 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 65.075605ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 374.00055ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:05:16 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 374.024236ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 62.075019ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:04:19 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 62.103171ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 70.031ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:03:37 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 70.056708ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 64.749171ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:02:32 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 64.768518ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 67.222731ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:02:09 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 67.24283ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 120.812109ms remote: "tcp:34.120.119.150:443" response headers: Content-Type=text/html; charset=UTF-8 Referrer-Policy=no-referrer Content-Length=298 Date=Tue, 19 May 2026 06:01:51 GMT Alt-Svc=h3=":443"; ma=2592000 target: https://www.tardigrade.io/ trace: https://jaeger.dev.storj.io/trace/66ea192edffbca9d FAIL (2026-05-19 06:01:51 UTC) orbiter warning: unexpected status code "503 Service Unavailable" "\n<html><head>\n<meta http-equiv=\"content-type\" content=\"text/html;charset=utf-8\">\n<title>503 Server Error</title>\n</head>\n<body text=#000000 bgcolor=#ffffff>\n<h1>Error: Server Error</h1>\n<h2>The service you requested is not available at this time.<p>Service error -27.</h2>\n<h2></h2>\n</body></html>\n" Duration: 120.85934ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.848607996s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:25:56 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.84863138s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.875518812s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:24:45 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.875542948s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.714866822s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:23:41 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.714892582s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.806850363s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:22:45 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.806873606s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.918169914s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:21:40 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.918193821s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.926828044s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 05:21:18 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.926886776s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.969391806s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 05:20:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 5.969416863s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.807580998s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:20:25 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.807604002s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.920403967s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 05:20:20 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.920427613s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.882766451s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 05:19:46 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.882794454s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.237410639s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 05:19:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 6.237434264s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.616604038s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 05:19:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.616627973s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.945636933s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:19:31 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.945657191s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.814348619s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 05:19:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 5.814372294s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.885855223s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 05:19:12 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.88587966s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.841200075s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 05:19:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.841215856s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.331851978s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:19:05 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.331875873s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.856534027s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 05:18:39 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.856553544s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 7.345315783s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 05:18:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 7.345342414s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.131489237s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 05:18:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 6.131517932s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.797678814s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:18:15 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.79770286s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.638168869s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 05:18:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.638193325s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.99406097s trace: https://jaeger.dev.storj.io/trace/4be74ab012e432ab FAIL (2026-05-19 05:17:48 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.994090606s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.920210297s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 05:17:41 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.920236317s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.54989983s trace: https://jaeger.dev.storj.io/trace/6ff7b82b817ca83b FAIL (2026-05-19 05:17:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== m2.100136312s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579624422 (441h49m2.100448177s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.579904426 (441h49m2.100728171s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580182467 (441h49m2.101006212s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580489753 (441h49m2.101313498s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.580809594 (441h49m2.101633339s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.581123182 (441h49m2.101946927s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.582262365 (441h49m2.10308611s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.583298262 (441h49m2.104122007s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:51.584185365 (441h49m2.10500911s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Uploading piece... May 19 04:36:52.855639968 (441h49m3.376463713s) [upload=423687]: Next returned nil segment May 19 04:36:52.855653854 (441h49m3.376477609s) [upload=423687]: Waiting for error group managing segments... May 19 04:36:53.129384314 (441h49m3.650208069s) [noise=true , address=77.90.31.11:4564 , piece_id=Q5TV7L4XILT4AUC25FZ2FYJQG7MOATXONP7WOYME2UCKRDN2FRDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9, address:77.90.31.11:4564): protocol: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35922->77.90.31.11:4564: use of closed network connection May 19 04:36:53.129655061 (441h49m3.650478816s) [noise=true , address=145.79.227.31:4806 , piece_id=JRQXJ2QTCJURFSDPI6J2BK2FRDXWH62QPRO2SKN2GCJQFZWHFGAQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1tWnxuTSo4yHAJUzvVFTmwPSNb8cBJJJ17BnKd5Z3HMYf66vSC, address:145.79.227.31:4806): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.129840054 (441h49m3.650663809s) [noise=true , address=145.79.227.11:4761 , piece_id=XEO6D6OPUCB7H6ZYTWVHUGMJIOQU3YV3FFAEKSV3VFBG4KCYMWCA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12CXHkaBwi15pBUoRiZHi6JP5rBDu1iVpWT1WFL3dCmk8LRRxqw, address:145.79.227.11:4761): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130053020 (441h49m3.650876765s) [noise=true , address=167.17.72.68:4656 , piece_id=QFD23JSHT76XGFOQW5OUNOYUYUZ32MJFCGHZXBS7SKJXWZSM5QTA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12bgJ2awZnNT2XAxjqB9xa5gkH9saVPiMLp6jRxvAmYeCipGvwe, address:167.17.72.68:4656): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130102976 (441h49m3.650926721s) [noise=true , address=167.17.72.71:4792 , piece_id=W3SREH7OJFXAICV2OHDCBECTWDQZJIRVVVPTX4CVKNQTE5BNDWDA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12BtQsaTvmZnx2665wpTh9bGY544BwYM5ngF6DXhNsQfnaHj4jF, address:167.17.72.71:4792): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130238243 (441h49m3.651061988s) [noise=true , address=193.149.164.78:4487 , piece_id=CWQ56I3TT4WEQ3Q25S4BFSIEVLOTGQTSIGG64R2CYD5LH3MC4GVA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12mmPVSsCJaWPi2j9PiPNTZaUYGMVWyrwWAQyYAZHrSruWqGzT5, address:193.149.164.78:4487): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130353263 (441h49m3.651177008s) [noise=true , address=145.79.227.38:4984 , piece_id=2324WP6PIWEURUYEIPTGGDBBJTJE6QLJ6IXXXLLZGFGULI7VYKXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv, address:145.79.227.38:4984): protocol: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37270->145.79.227.38:4984: use of closed network connection May 19 04:36:53.130424819 (441h49m3.651248574s) [noise=true , address=193.149.164.79:4509 , piece_id=ALECG5YMVHOXIOOTELU2QO3MQCLRZDVGKL3IFSCAN4JXVC4HFVGA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12onV5hDDwMffqse4SQGJt1ehrSqmL2v7iyShB9fVnE5XLMGRQ, address:193.149.164.79:4509): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130497178 (441h49m3.651320923s) [noise=true , address=193.149.164.70:4105 , piece_id=TAGNJJXDVJE72VCJYBJPNDADXWRJTRRGI7B4PWZEPGDKSKH4YCXA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1PjkPL98hM8UKx9uJ84f4ZiFgDx5jGQZhSqsoK5QKpY2ZevRwe, address:193.149.164.70:4105): protocol: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56092->193.149.164.70:4105: use of closed network connection May 19 04:36:53.130558946 (441h49m3.651382701s) [noise=true , address=77.90.31.18:4816 , piece_id=SE5FCUR7OYV2NRWKQLQ73RH3XJZRZ3B5BFMXYQO52KORVMGAG3PA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130747094 (441h49m3.651570839s) [noise=true , address=145.79.227.3:4164 , piece_id=SK3ES7XM7SF3AUSMJ7ECLVRMJ7BOOAPDKJAZ7UE5UR62IPTJUKUQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12iQgyDiz9vu1TbCRuATGmnrfbgBaia72b77ZjQJ6gpnEFbQzTJ, address:145.79.227.3:4164): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130812198 (441h49m3.651635944s) [noise=true , address=77.90.31.13:4634 , piece_id=XUC5PUSSNDOTVNR6UCSAKPZDDWJATFJ47YD47WC4WOECARC4ERFA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1WwFU9dJW2LLdTQ64FLEpt4qyQLVuiEb8PmSLrUokav2HGVCw7, address:77.90.31.13:4634): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.130877593 (441h49m3.651701348s) [noise=true , address=193.149.164.69:4073 , piece_id=LCKSXQEKVMPEILU7VIHJSBB3254GXHEFXONTWW7DNRUIDCX4KBMA, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12fT15GHYtqKHA6GqVVUPGdJpysLYAU6opHyNpED7VYsKX4XnHp, address:193.149.164.69:4073): protocol: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42146->193.149.164.69:4073: use of closed network connection May 19 04:36:53.131074439 (441h49m3.651898194s) [noise=true , address=193.149.164.66:4975 , piece_id=7BPNRVOHYODJVVNYCTDLXXGVQFNKA4O53XTQUKDYLDO3VUV2FZ2A, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:1xRD2oLpCcanwnk4qfFkEn7pFQ3HUFNPeo7NJF8FDb1XBkdhEA, address:193.149.164.66:4975): protocol: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55118->193.149.164.66:4975: use of closed network connection May 19 04:36:53.131309869 (441h49m3.652133624s) [noise=true , address=167.17.72.70:4767 , piece_id=GQPYU5BK6J6ENCZLP3FYODHBIXWGER7PDLXKUX6HJUPTWDRMWNYQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12GyCnxNSzFpMZgnxBVVKyR6WkY1nrzqQWkuLLpwBri7kWP5rjc, address:167.17.72.70:4767): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131446258 (441h49m3.652270073s) [noise=true , address=145.79.227.36:4537 , piece_id=SWJRYQO2QNOBVOFQZXZC3I3KUK5FKMHZZ324RG3PRNB4VPVZHJCQ, seg_pos={0 0}, upload=423687]: Done uploading piece. err: ecclient: upload failed (node:12LTTCDNikuwf94KeKsQGFSu6ABXVYt1ombRsEyrZN5JC8d4Eot, address:145.79.227.36:4537): protocol: expected piece hash; context deadline exceeded; EOF May 19 04:36:53.131480273 (441h49m3.652304028s) [seg_pos={0 0}, upload=423687]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> May 19 04:36:53.365945030 (441h49m3.886768775s) [upload=423687]: Done uploading segments... May 19 04:36:53.365986378 (441h49m3.886810123s) [upload=423687]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 0) Duration: 6.549922272s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.655539966s trace: https://jaeger.dev.storj.io/trace/5bc70c78246bb3a3 FAIL (2026-05-19 05:17:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 19 04:36:26.642132543 (441h48m37.162956289s) [upload=423679]: Starting upload May 19 04:36:26.642247884 (441h48m37.163071659s) [upload=423679]: Done starting upload May 19 04:36:26.642343847 (441h48m37.163167602s) [upload=423679]: Uploading segments... May 19 04:36:26.642693143 (441h48m37.163516888s) [upload=423679]: Got next segment. Inline: false May 19 04:36:26.642734001 (441h48m37.163557756s) [upload=423679]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 19 04:36:26.642739411 (441h48m37.163563176s) [upload=423679]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 19 04:36:34.775458422 (441h48m45.296282207s) [upload=423679]: Next segment err: context deadline exceeded May 19 04:36:34.775690364 (441h48m45.29651411s) [upload=423679]: Done uploading segments... May 19 04:36:34.775723928 (441h48m45.296547673s) [upload=423679]: Upload finished. err: context deadline exceeded Duration: 5.655564483s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.89223223s trace: https://jaeger.dev.storj.io/trace/5bdd61167d3b0aa FAIL (2026-05-19 05:17:23 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.892254972s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)