Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
4.711172572s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:16:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.711200846s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
4.710630967s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:15:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.710653351s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
4.285387552s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:14:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.28540708s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
4.644038715s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:13:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.644063884s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
4.780568296s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:13:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.78059158s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
4.803398079s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:12:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.803417947s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
4.284431967s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:11:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.284460081s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.681283501s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:11:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.681306305s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.300650221s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:10:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.300685129s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.241772069s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:09:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.2417981s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
4.644545992s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:08:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.644570229s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.289492541s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:08:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.289514542s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
4.211907186s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:07:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.211935912s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
4.335609875s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:07:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.335634203s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
4.6599032s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:05:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.659931222s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
4.660534531s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:05:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.660564619s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
4.217327444s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:03:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.217349747s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
4.244464104s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:03:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.244487611s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
4.658417075s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:02:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.658449397s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
4.711686441s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:01:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.71171226s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
4.720288862s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 11:00:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.720311135s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
4.712939865s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:59:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.712965877s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.710843345s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:59:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.710864515s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.26886003s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:58:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.268892172s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
4.259320637s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:57:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.259350315s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.214693031s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:56:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 5.214716426s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.676926803s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:55:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.676951831s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.620983457s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:54:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.621013396s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.094681554s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:54:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 5.094704398s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.632839641s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:53:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.632863106s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
4.66354696s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:52:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.663576627s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.70698619s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:51:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.707017581s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.332811033s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:51:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.332836953s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.60322155s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:50:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.603247089s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
4.428083623s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:49:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.428109732s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
3.822542807s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:49:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 3.822574066s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.303302333s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:48:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.303326699s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
4.70223572s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:47:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.702279645s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
4.642520582s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:46:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.642549086s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.224183064s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:45:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.224221988s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
4.321996872s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:44:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.322016539s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.71099579s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:43:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.711018712s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
4.290922631s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:42:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.290947399s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.225890103s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:41:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.22591528s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
4.978175428s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:41:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.978204495s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.07934496s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:40:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 5.079374285s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
4.655912832s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:39:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.655936527s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.328970921s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:38:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.32899094s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.269196592s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:37:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.269219388s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.277701023s trace:
https://jaeger.dev.storj.io/trace/592cbfc80e677e14
FAIL (2026-04-12 10:37:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539435563 (114h50m9.358671587s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539710113 (114h50m9.358946137s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.539764759 (114h50m9.359000773s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540006816 (114h50m9.35924284s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540136366 (114h50m9.35937239s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540319840 (114h50m9.359555874s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540432808 (114h50m9.359668832s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.540640578 (114h50m9.359876602s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541006875 (114h50m9.360242899s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:22.541400756 (114h50m9.36063678s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Uploading piece...
Apr 12 10:36:23.349633396 (114h50m10.16886942s) [upload=110166]: Next returned nil segment
Apr 12 10:36:23.349644738 (114h50m10.168880762s) [upload=110166]: Waiting for error group managing segments...
Apr 12 10:36:23.740271885 (114h50m10.559507909s) [noise=true , address=185.167.204.205:4003 , piece_id=Z46AIVYST474LK2DW2KNPF72KCMLVP3ISCRS4TJ6J35WRZWN6H6A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.740484905 (114h50m10.559720929s) [noise=true , address=185.167.204.206:4054 , piece_id=GOY2GZ47YXDHLCLPGPYRGAIT4RSR3USRXS2STZEXBEEREI3LMPSA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741156452 (114h50m10.560392476s) [noise=true , address=185.167.204.206:4050 , piece_id=QJ7KTMW3TLVECDWLMRVRDTQ2ZTWOMPGQAIW7NOG4OCW5N43QJU5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.741735169 (114h50m10.560971193s) [noise=true , address=185.167.204.205:4012 , piece_id=UC3PTXR3K36CZKWKYZ4HWECS5P2E7EWIZ6U44SLPS37WD65QUKKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.742736140 (114h50m10.561972164s) [noise=true , address=185.167.204.205:4029 , piece_id=Z2P6FBMTNOAK5OBPJC6UVCM6NQCORP7MJTREAABYILVXFB3NDY6Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.744463004 (114h50m10.563699038s) [noise=true , address=185.167.204.206:4047 , piece_id=4CH23KM6KWG5APQPTH2NIMLDXJ5O6NYBRG4JH4T2K6M62STNNN5Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.747965372 (114h50m10.567201396s) [noise=true , address=185.167.204.206:4071 , piece_id=NELGJUJ5EJAW6JF6F4WFLREORYMP3SLZ6MQS5S44P4UMD2ZB3IPA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751228410 (114h50m10.570464434s) [noise=true , address=185.167.204.205:4033 , piece_id=Y4TK3GYRCTRPGFBT56EYAX4WL4UPCZO5EN5PARCLHNX6N655444A, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.751844900 (114h50m10.571080924s) [noise=true , address=185.167.204.205:4018 , piece_id=L3P5IPL23RHJPC2J2ZKMZIS4FJPECRUF6IT56J5NUIZGYTIKF3BA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.754324244 (114h50m10.573560279s) [noise=true , address=185.167.204.205:4015 , piece_id=AFOMSAAYB7OBQ26GKF76FUUTRHA2CK7QQBCFGE4OWEWXKTTUDLMA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.755710260 (114h50m10.574946284s) [noise=true , address=185.167.204.205:4013 , piece_id=JHXLLCAANPQXNFGCPYETNTYI5CTGVQ4V7D7OFDVENKDCPE27YLHQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757050005 (114h50m10.576286029s) [noise=true , address=185.167.204.205:4016 , piece_id=ZQ6WUBFB2HMMA32AFAC4MAM6ZG7BA7JBNTF36XS7KCOZXLH2UWEA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.757239010 (114h50m10.576475034s) [noise=true , address=185.167.204.206:4039 , piece_id=OK7N6W4FBAIDSQDWSENARQMYYTSKY7VRPCZOYXKIN46NJAQK2QZQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.765222758 (114h50m10.584458783s) [noise=true , address=185.167.204.205:4014 , piece_id=RH3S3FRGKIMPVAPHMOPMDSNZSVSTVKPTB4WA3IARY2I7WCGHDF7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:23.767668568 (114h50m10.586904592s) [noise=true , address=185.167.204.206:4060 , piece_id=7HLR3N6UEL3L3JUIY64P2JWZS6ZUUKSIGM4F7HH4HEP6NYXVKFIQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.111590026 (114h50m10.93082605s) [noise=true , address=81.171.14.70:4031 , piece_id=BG7NY2FEV2VWNCCTEA4K2JKGYDOPITCIUDUR2QXHN2R755SVACKA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.478835027 (114h50m11.298071051s) [noise=true , address=89.149.201.147:4013 , piece_id=I2ZDGNG3G6ZAOZ7EUICMZWIQYLMFYAYZI7UDUE5VZXP7S7XUIDTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.568435100 (114h50m11.387671124s) [noise=true , address=81.171.14.70:4038 , piece_id=UCZLRWHMB5RLKOPQBBYUEMKTHIDGNPRXPH6RSERPSKDKHY5GJ5HA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.761764383 (114h50m11.581000407s) [noise=true , address=81.171.14.70:4044 , piece_id=526OGHAGQMBJFJZQ5H7T4YW2WTXP7ZNYVMJR7I6YLAMPOPS7RKTA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:24.852786711 (114h50m11.672022735s) [noise=true , address=81.171.14.70:4032 , piece_id=YZECSEAXCDQAYM2GCOSQWA2L4F3SUMDJFQ3IGUBWTHVCRDEOSE7Q, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.172275816 (114h50m11.99151184s) [noise=true , address=81.171.14.70:4033 , piece_id=VTORSJ5UAS2FSCUMVOK6JFJRY7QJWJ5M6IXDY6ZPT2X6NBHYS7XQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.222371728 (114h50m12.041607752s) [noise=true , address=89.149.201.147:4010 , piece_id=O2XB4MHSHKR77PW32JK67LZUEJFQCSBNFHXUTNG5RP6SMGYVZAYA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.326526961 (114h50m12.145762975s) [noise=true , address=81.171.14.70:4043 , piece_id=RICIXL6EUOY3Y7HB5TUF2ZX7V6EOQAQXKBCV6TA5P2Y7A4ECUHAA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.356787482 (114h50m12.176023506s) [noise=true , address=81.171.14.70:4030 , piece_id=37A6KYB5C2VUTPFNO23K63BHQ6ZIPXOUMN7AC2I3S46VF4QPV4XA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:25.509100057 (114h50m12.328336081s) [noise=true , address=89.149.201.147:4001 , piece_id=CHD2SEFYNVNBARBEGAF2B2BQV4FZBUVL2TRQKSW2MO6O33EHEZOQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088454967 (114h50m14.907690991s) [noise=true , address=89.149.201.147:4003 , piece_id=VAODN7SEHULPDFUADJKVABNTKSOCPWDA7VOXLHE62L35EHWSNYLA, seg_pos={0 0}, upload=110166]: Done uploading piece. err: <nil>
Apr 12 10:36:28.088477822 (114h50m14.907713846s) [seg_pos={0 0}, upload=110166]: Satisfied cohort requirements after 26 pieces
Apr 12 10:36:28.088652949 (114h50m14.907888974s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088660825 (114h50m14.907896849s) [noise=true , address=89.149.201.147:4023 , piece_id=6VJOX25KAAX2IU2EIQSZIONH7TEVPTKYN4LYYZEDCFDJBCOGVIPQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088686765 (114h50m14.907922789s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: expected piece hash; context canceled; EOF
Apr 12 10:36:28.088760407 (114h50m14.907996481s) [noise=true , address=89.149.201.147:4005 , piece_id=TFDOOPHVDS65SH6VZ2WGN5ZG4TQ23U5YRBLOOQZ2V2LDR3OMVIFQ, seg_pos={0 0}, upload=110166]: Long tail cancellation due to optimal threshold
Apr 12 10:36:28.088807468 (114h50m14.908043542s) [seg_pos={0 0}, upload=110166]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Apr 12 10:36:28.088955534 (114h50m14.908191558s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 12 10:36:28.088962998 (114h50m14.908199022s) [upload=110166]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 12 10:36:28.332866457 (114h50m15.152102501s) [upload=110166]: Done uploading segments...
Apr 12 10:36:28.332891716 (114h50m15.15212774s) [upload=110166]: Upload finished. err: <nil>
Duration: 4.277730641s
core
uplink
eu-select-1
eu1-placement-15
|