Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 7.494010956s trace: https://jaeger.dev.storj.io/trace/bb228e6f4e56e8d FAIL (2026-05-26 03:36:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== May 26 03:34:51.057311479 (25h30m36.840651579s) [upload=24400]: Starting upload May 26 03:34:51.057391622 (25h30m36.840731721s) [upload=24400]: Done starting upload May 26 03:34:51.057490661 (25h30m36.84083076s) [upload=24400]: Uploading segments... May 26 03:34:51.057591854 (25h30m36.840931953s) [upload=24400]: Got next segment. Inline: false May 26 03:34:51.057625859 (25h30m36.840965958s) [upload=24400]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 03:34:51.057629526 (25h30m36.840969625s) [upload=24400]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 03:34:51.292929294 (25h30m37.076269403s) [seg_pos={0 0}, upload=24400]: Begin upload segment... May 26 03:34:51.292964903 (25h30m37.076305002s) [seg_pos={0 0}, upload=24400]: Done begin upload segment. May 26 03:34:51.292989609 (25h30m37.076329708s) [noise=true , address=193.149.164.79:4519 , piece_id=TUMGIPTR4S5DH52NXSYJ4XO2J4NY32MMDYNGCCQFEZWKQGGKPXMA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.293001382 (25h30m37.076341471s) [noise=true , address=145.79.227.15:4886 , piece_id=TDZGTW5XAY556AK6TSF77NSO5SZ4NMSCXKA7UWJI5JP5JD77GHNA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.293425101 (25h30m37.0767652s) [noise=true , address=77.90.31.16:4741 , piece_id=5R4PRRZH23RXIAR2OW6UEMSEZSSNJRGTMLUPS7XPUNOWIKDPJCPQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.293751414 (25h30m37.077091513s) [noise=true , address=145.79.227.27:4713 , piece_id=WQCHEO37RTEZPPLOC2VODLMSCHMQJIKAWVQXOMRFPIAWQBW5ICEQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.294126739 (25h30m37.077466838s) [noise=true , address=77.90.31.10:4523 , piece_id=HKAHCRV6A56O4IVDNCH7XLA6F46LJWG5AQVOO6VSC2A44FJETQOA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.294459584 (25h30m37.077799673s) [noise=true , address=45.91.116.13:4172 , piece_id=4TDNGUKRNXUSAM5VIHMN3WKGPINTAFBKGW2TQHLB2EJSQYHC562Q, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.294747314 (25h30m37.078087413s) [noise=true , address=45.91.116.11:4146 , piece_id=LNPP32ULINK5DMOGMYXQHIMFBZ3WK4E2FMSGZBDHQ4JIIO277PGQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295038469 (25h30m37.078378558s) [noise=true , address=145.79.227.6:4290 , piece_id=QFMX4XC7KKPVRS2I5BY2A7J4I36PSPV6TUID2BYU5DSZD5BW6JBA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295304607 (25h30m37.078644706s) [noise=true , address=64.49.13.27:4966 , piece_id=P5KKTYHEQHYFSX3NUPZYLWPANMGVZQ5TEFWUDVM2MNRARCALCQEQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295608777 (25h30m37.078948876s) [noise=true , address=77.90.31.11:4579 , piece_id=ISHWIRMXXBRLGEFTOOLWVO5LFMJSPRLG4FTZBQ5QYIVCZMSKEDGQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295911264 (25h30m37.079251363s) [noise=true , address=167.17.72.71:4781 , piece_id=RNZYCCOYUWBRED5CYLWAYN45JE2YPMN5NBEB37QWIBJXSUJINXCA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.296369418 (25h30m37.079709517s) [noise=true , address=167.17.72.69:4728 , piece_id=7E2HBBOSORYIC252ZUCYRZZE7GYYASJOX4ISTYYOXOKDEWBCSBYA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.296709377 (25h30m37.080049476s) [noise=true , address=145.79.227.16:4933 , piece_id=FYYQJFTVO6HZ3DOT6P5RPEG5BY2SWXL6NJND4J5JA3MZMOXDJZXA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.297572744 (25h30m37.080912833s) [noise=true , address=64.49.13.170:4720 , piece_id=3JSZ3RY72MI6B5UZ4YF573TDEXJ7YHY5CSIQCBLWWANB4VQELJWA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.297731818 (25h30m37.081071917s) [noise=true , address=145.79.227.17:4978 , piece_id=RMAJF4V52KZ3I22H7LO36T3UY56KCPRDAGJQFDD4MN3WPPDUQ4EQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.298580286 (25h30m37.081920385s) [noise=true , address=193.149.164.78:4477 , piece_id=KYNLJJXC6KSJ2PVMHFPX32PULM4KX62KTGUYLOGKTVBB4QRKUBGA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:52.567697680 (25h30m38.351037769s) [upload=24400]: Next returned nil segment May 26 03:34:52.567710364 (25h30m38.351050453s) [upload=24400]: Waiting for error group managing segments... May 26 03:34:52.916105923 (25h30m38.699446022s) [noise=true , address=64.49.13.170:4720 , piece_id=3JSZ3RY72MI6B5UZ4YF573TDEXJ7YHY5CSIQCBLWWANB4VQELJWA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:52.926296076 (25h30m38.709636175s) [noise=true , address=193.149.164.78:4477 , piece_id=KYNLJJXC6KSJ2PVMHFPX32PULM4KX62KTGUYLOGKTVBB4QRKUBGA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:52.979491645 (25h30m38.762831744s) [noise=true , address=64.49.13.27:4966 , piece_id=P5KKTYHEQHYFSX3NUPZYLWPANMGVZQ5TEFWUDVM2MNRARCALCQEQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.040935621 (25h30m38.82427572s) [noise=true , address=193.149.164.79:4519 , piece_id=TUMGIPTR4S5DH52NXSYJ4XO2J4NY32MMDYNGCCQFEZWKQGGKPXMA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.166520140 (25h30m38.949860239s) [noise=true , address=145.79.227.16:4933 , piece_id=FYYQJFTVO6HZ3DOT6P5RPEG5BY2SWXL6NJND4J5JA3MZMOXDJZXA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.178543722 (25h30m38.961883831s) [noise=true , address=145.79.227.15:4886 , piece_id=TDZGTW5XAY556AK6TSF77NSO5SZ4NMSCXKA7UWJI5JP5JD77GHNA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.186434207 (25h30m38.969774316s) [noise=true , address=145.79.227.6:4290 , piece_id=QFMX4XC7KKPVRS2I5BY2A7J4I36PSPV6TUID2BYU5DSZD5BW6JBA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.246791750 (25h30m39.030131849s) [noise=true , address=145.79.227.27:4713 , piece_id=WQCHEO37RTEZPPLOC2VODLMSCHMQJIKAWVQXOMRFPIAWQBW5ICEQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.253734938 (25h30m39.037075037s) [noise=true , address=145.79.227.17:4978 , piece_id=RMAJF4V52KZ3I22H7LO36T3UY56KCPRDAGJQFDD4MN3WPPDUQ4EQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.545641886 (25h30m39.328981985s) [noise=true , address=167.17.72.69:4728 , piece_id=7E2HBBOSORYIC252ZUCYRZZE7GYYASJOX4ISTYYOXOKDEWBCSBYA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:54.536476788 (25h30m40.319816887s) [noise=true , address=45.91.116.13:4172 , piece_id=4TDNGUKRNXUSAM5VIHMN3WKGPINTAFBKGW2TQHLB2EJSQYHC562Q, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:54.731478628 (25h30m40.514818727s) [noise=true , address=45.91.116.11:4146 , piece_id=LNPP32ULINK5DMOGMYXQHIMFBZ3WK4E2FMSGZBDHQ4JIIO277PGQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:54.814909195 (25h30m40.598249294s) [noise=true , address=167.17.72.71:4781 , piece_id=RNZYCCOYUWBRED5CYLWAYN45JE2YPMN5NBEB37QWIBJXSUJINXCA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:35:50.395667765 (25h31m36.179007854s) [noise=true , address=77.90.31.11:4579 , piece_id=ISHWIRMXXBRLGEFTOOLWVO5LFMJSPRLG4FTZBQ5QYIVCZMSKEDGQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: ecclient: upload failed (node:12dRcuBLuT2ybWGzdkp4vyo7e37qrZk6SBpWWHty5WKRoVHp1p, address:77.90.31.11:4579): protocol: write tcp 188.166.225.170:40706->77.90.31.11:4579: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:35:50.395764269 (25h31m36.179104358s) [noise=true , address=77.90.31.10:4523 , piece_id=HKAHCRV6A56O4IVDNCH7XLA6F46LJWG5AQVOO6VSC2A44FJETQOA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: ecclient: upload failed (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa, address:77.90.31.10:4523): protocol: rpc: dial tcp 77.90.31.10:4523: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:35:50.395792703 (25h31m36.179132802s) [noise=true , address=77.90.31.16:4741 , piece_id=5R4PRRZH23RXIAR2OW6UEMSEZSSNJRGTMLUPS7XPUNOWIKDPJCPQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: ecclient: upload failed (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR, address:77.90.31.16:4741): protocol: write tcp 188.166.225.170:45908->77.90.31.16:4741: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:35:50.395808893 (25h31m36.179148992s) [seg_pos={0 0}, upload=24400]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> May 26 03:35:50.632114722 (25h31m36.415454841s) [upload=24400]: Done uploading segments... May 26 03:35:50.632169156 (25h31m36.415509255s) [upload=24400]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.494024872s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 3.987347292s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:36:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 3.987364785s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.238513159s trace: https://jaeger.dev.storj.io/trace/bb228e6f4e56e8d FAIL (2026-05-26 03:35:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== May 26 03:34:51.057311479 (25h30m36.840651579s) [upload=24400]: Starting upload May 26 03:34:51.057391622 (25h30m36.840731721s) [upload=24400]: Done starting upload May 26 03:34:51.057490661 (25h30m36.84083076s) [upload=24400]: Uploading segments... May 26 03:34:51.057591854 (25h30m36.840931953s) [upload=24400]: Got next segment. Inline: false May 26 03:34:51.057625859 (25h30m36.840965958s) [upload=24400]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 03:34:51.057629526 (25h30m36.840969625s) [upload=24400]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 03:34:51.292929294 (25h30m37.076269403s) [seg_pos={0 0}, upload=24400]: Begin upload segment... May 26 03:34:51.292964903 (25h30m37.076305002s) [seg_pos={0 0}, upload=24400]: Done begin upload segment. May 26 03:34:51.292989609 (25h30m37.076329708s) [noise=true , address=193.149.164.79:4519 , piece_id=TUMGIPTR4S5DH52NXSYJ4XO2J4NY32MMDYNGCCQFEZWKQGGKPXMA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.293001382 (25h30m37.076341471s) [noise=true , address=145.79.227.15:4886 , piece_id=TDZGTW5XAY556AK6TSF77NSO5SZ4NMSCXKA7UWJI5JP5JD77GHNA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.293425101 (25h30m37.0767652s) [noise=true , address=77.90.31.16:4741 , piece_id=5R4PRRZH23RXIAR2OW6UEMSEZSSNJRGTMLUPS7XPUNOWIKDPJCPQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.293751414 (25h30m37.077091513s) [noise=true , address=145.79.227.27:4713 , piece_id=WQCHEO37RTEZPPLOC2VODLMSCHMQJIKAWVQXOMRFPIAWQBW5ICEQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.294126739 (25h30m37.077466838s) [noise=true , address=77.90.31.10:4523 , piece_id=HKAHCRV6A56O4IVDNCH7XLA6F46LJWG5AQVOO6VSC2A44FJETQOA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.294459584 (25h30m37.077799673s) [noise=true , address=45.91.116.13:4172 , piece_id=4TDNGUKRNXUSAM5VIHMN3WKGPINTAFBKGW2TQHLB2EJSQYHC562Q, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.294747314 (25h30m37.078087413s) [noise=true , address=45.91.116.11:4146 , piece_id=LNPP32ULINK5DMOGMYXQHIMFBZ3WK4E2FMSGZBDHQ4JIIO277PGQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295038469 (25h30m37.078378558s) [noise=true , address=145.79.227.6:4290 , piece_id=QFMX4XC7KKPVRS2I5BY2A7J4I36PSPV6TUID2BYU5DSZD5BW6JBA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295304607 (25h30m37.078644706s) [noise=true , address=64.49.13.27:4966 , piece_id=P5KKTYHEQHYFSX3NUPZYLWPANMGVZQ5TEFWUDVM2MNRARCALCQEQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295608777 (25h30m37.078948876s) [noise=true , address=77.90.31.11:4579 , piece_id=ISHWIRMXXBRLGEFTOOLWVO5LFMJSPRLG4FTZBQ5QYIVCZMSKEDGQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.295911264 (25h30m37.079251363s) [noise=true , address=167.17.72.71:4781 , piece_id=RNZYCCOYUWBRED5CYLWAYN45JE2YPMN5NBEB37QWIBJXSUJINXCA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.296369418 (25h30m37.079709517s) [noise=true , address=167.17.72.69:4728 , piece_id=7E2HBBOSORYIC252ZUCYRZZE7GYYASJOX4ISTYYOXOKDEWBCSBYA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.296709377 (25h30m37.080049476s) [noise=true , address=145.79.227.16:4933 , piece_id=FYYQJFTVO6HZ3DOT6P5RPEG5BY2SWXL6NJND4J5JA3MZMOXDJZXA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.297572744 (25h30m37.080912833s) [noise=true , address=64.49.13.170:4720 , piece_id=3JSZ3RY72MI6B5UZ4YF573TDEXJ7YHY5CSIQCBLWWANB4VQELJWA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.297731818 (25h30m37.081071917s) [noise=true , address=145.79.227.17:4978 , piece_id=RMAJF4V52KZ3I22H7LO36T3UY56KCPRDAGJQFDD4MN3WPPDUQ4EQ, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:51.298580286 (25h30m37.081920385s) [noise=true , address=193.149.164.78:4477 , piece_id=KYNLJJXC6KSJ2PVMHFPX32PULM4KX62KTGUYLOGKTVBB4QRKUBGA, seg_pos={0 0}, upload=24400]: Uploading piece... May 26 03:34:52.567697680 (25h30m38.351037769s) [upload=24400]: Next returned nil segment May 26 03:34:52.567710364 (25h30m38.351050453s) [upload=24400]: Waiting for error group managing segments... May 26 03:34:52.916105923 (25h30m38.699446022s) [noise=true , address=64.49.13.170:4720 , piece_id=3JSZ3RY72MI6B5UZ4YF573TDEXJ7YHY5CSIQCBLWWANB4VQELJWA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:52.926296076 (25h30m38.709636175s) [noise=true , address=193.149.164.78:4477 , piece_id=KYNLJJXC6KSJ2PVMHFPX32PULM4KX62KTGUYLOGKTVBB4QRKUBGA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:52.979491645 (25h30m38.762831744s) [noise=true , address=64.49.13.27:4966 , piece_id=P5KKTYHEQHYFSX3NUPZYLWPANMGVZQ5TEFWUDVM2MNRARCALCQEQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.040935621 (25h30m38.82427572s) [noise=true , address=193.149.164.79:4519 , piece_id=TUMGIPTR4S5DH52NXSYJ4XO2J4NY32MMDYNGCCQFEZWKQGGKPXMA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.166520140 (25h30m38.949860239s) [noise=true , address=145.79.227.16:4933 , piece_id=FYYQJFTVO6HZ3DOT6P5RPEG5BY2SWXL6NJND4J5JA3MZMOXDJZXA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.178543722 (25h30m38.961883831s) [noise=true , address=145.79.227.15:4886 , piece_id=TDZGTW5XAY556AK6TSF77NSO5SZ4NMSCXKA7UWJI5JP5JD77GHNA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.186434207 (25h30m38.969774316s) [noise=true , address=145.79.227.6:4290 , piece_id=QFMX4XC7KKPVRS2I5BY2A7J4I36PSPV6TUID2BYU5DSZD5BW6JBA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.246791750 (25h30m39.030131849s) [noise=true , address=145.79.227.27:4713 , piece_id=WQCHEO37RTEZPPLOC2VODLMSCHMQJIKAWVQXOMRFPIAWQBW5ICEQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.253734938 (25h30m39.037075037s) [noise=true , address=145.79.227.17:4978 , piece_id=RMAJF4V52KZ3I22H7LO36T3UY56KCPRDAGJQFDD4MN3WPPDUQ4EQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:53.545641886 (25h30m39.328981985s) [noise=true , address=167.17.72.69:4728 , piece_id=7E2HBBOSORYIC252ZUCYRZZE7GYYASJOX4ISTYYOXOKDEWBCSBYA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:54.536476788 (25h30m40.319816887s) [noise=true , address=45.91.116.13:4172 , piece_id=4TDNGUKRNXUSAM5VIHMN3WKGPINTAFBKGW2TQHLB2EJSQYHC562Q, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:54.731478628 (25h30m40.514818727s) [noise=true , address=45.91.116.11:4146 , piece_id=LNPP32ULINK5DMOGMYXQHIMFBZ3WK4E2FMSGZBDHQ4JIIO277PGQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:34:54.814909195 (25h30m40.598249294s) [noise=true , address=167.17.72.71:4781 , piece_id=RNZYCCOYUWBRED5CYLWAYN45JE2YPMN5NBEB37QWIBJXSUJINXCA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: <nil> May 26 03:35:50.395667765 (25h31m36.179007854s) [noise=true , address=77.90.31.11:4579 , piece_id=ISHWIRMXXBRLGEFTOOLWVO5LFMJSPRLG4FTZBQ5QYIVCZMSKEDGQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: ecclient: upload failed (node:12dRcuBLuT2ybWGzdkp4vyo7e37qrZk6SBpWWHty5WKRoVHp1p, address:77.90.31.11:4579): protocol: write tcp 188.166.225.170:40706->77.90.31.11:4579: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:35:50.395764269 (25h31m36.179104358s) [noise=true , address=77.90.31.10:4523 , piece_id=HKAHCRV6A56O4IVDNCH7XLA6F46LJWG5AQVOO6VSC2A44FJETQOA, seg_pos={0 0}, upload=24400]: Done uploading piece. err: ecclient: upload failed (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa, address:77.90.31.10:4523): protocol: rpc: dial tcp 77.90.31.10:4523: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:35:50.395792703 (25h31m36.179132802s) [noise=true , address=77.90.31.16:4741 , piece_id=5R4PRRZH23RXIAR2OW6UEMSEZSSNJRGTMLUPS7XPUNOWIKDPJCPQ, seg_pos={0 0}, upload=24400]: Done uploading piece. err: ecclient: upload failed (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR, address:77.90.31.16:4741): protocol: write tcp 188.166.225.170:45908->77.90.31.16:4741: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:35:50.395808893 (25h31m36.179148992s) [seg_pos={0 0}, upload=24400]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> May 26 03:35:50.632114722 (25h31m36.415454841s) [upload=24400]: Done uploading segments... May 26 03:35:50.632169156 (25h31m36.415509255s) [upload=24400]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.238522477s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.129023665s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:35:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.129050285s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 4.651382502s trace: https://jaeger.dev.storj.io/trace/58499abd97a4a547 FAIL (2026-05-26 03:35:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:07.482929983 (25h28m53.266270072s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:08.324361378 (25h28m54.107701477s) [upload=24372]: Next returned nil segment May 26 03:33:08.324374614 (25h28m54.107714703s) [upload=24372]: Waiting for error group managing segments... May 26 03:33:08.731031075 (25h28m54.514371174s) [noise=true , address=81.171.14.70:4039 , piece_id=GFPLM7V2D4I2XSTWNIU3322NH4RNAD33QI3GVP3N7WDWG3DUU64Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731274119 (25h28m54.514614218s) [noise=true , address=81.171.14.70:4026 , piece_id=ZQLJIJPHJ2KP65YOMMZNILTNR6WYYHSVSPKBU4WKFTOQFNI3VCVQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731699240 (25h28m54.515039339s) [noise=true , address=81.171.14.70:4048 , piece_id=7B5HNGMTIYVRA3YBRXPX5UN4YLKA47SA3VEA6V5VKTE5HKNKRXZQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.740303036 (25h28m54.523643126s) [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.746923018 (25h28m54.530263107s) [noise=true , address=81.171.14.70:4042 , piece_id=WXRNES7VUHBWFEBLVPJFHOMCB36C35BRZOPIDKY37EC3XL272H4Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.787794853 (25h28m54.571134952s) [noise=true , address=81.171.14.70:4041 , piece_id=GALIU56QSLRKVUA4PPLGYWFR7TLDCHJMWM6ZFSYXBIZE2T3NKE5A, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.223068517 (25h28m55.006408616s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.230623161 (25h28m55.01396326s) [noise=true , address=81.171.14.70:4043 , piece_id=NMZQKARJH6BVDK6HCQTR7AUTY6SFTQM7J5FA37ZYNMEPY3PBPZTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.231318919 (25h28m55.014659018s) [noise=true , address=89.149.201.147:4011 , piece_id=HRINJWZ55AT43T7YKNCXU3WJIGLOD6WS63YV4NNL6AYS35XRCXFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.234455043 (25h28m55.017795142s) [noise=true , address=89.149.201.147:4021 , piece_id=QM5OZORHMNRUTV7BNXUZN66UKFN3FU4HBJ7JJ6BY42GAR65SVDMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.250660443 (25h28m55.034000542s) [noise=true , address=89.149.201.147:4017 , piece_id=MXYGBV5XQEM3RWWSWWWVNJMGH2UJGT2IFPDSNQX5DPWGGACKJHTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.280697715 (25h28m55.064037814s) [noise=true , address=89.149.201.147:4009 , piece_id=Q2FKJYIANL7NYOY4F7JGJK6SU5MUSLYUZ7FGWG26CFTA4FHJXGSQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.305574250 (25h28m55.088914349s) [noise=true , address=89.149.201.147:4020 , piece_id=BWDGFP3HHL4DJTNA4RZHGHKJKSKIRKNXQCXFKLA3CQNC56IW7CRA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.326442828 (25h28m55.109782927s) [noise=true , address=89.149.201.147:4014 , piece_id=Z3ONVFREJGQVKARJMVY3XDZ5DFQUYCG32I2MYSRXYHPVWGHBDCVA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.371048036 (25h28m55.154388125s) [noise=true , address=89.149.201.147:4010 , piece_id=7WWA7ZEMEEVSLO2A43ABF72GBXM7K7RFU4AIBRCUZKN2Z6ICSGPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:34:06.805550190 (25h29m52.58889029s) [noise=true , address=185.167.204.205:4027 , piece_id=OXLJIIPWJHYL6JJMFP3A7554T4IZK6MCFNDVEY4QWSVEXJ6TIQYA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805635323 (25h29m52.588975472s) [noise=true , address=185.167.204.206:4050 , piece_id=4F7GNQFFMNVYG3NEN6WYMFCKSQJJHPAWF6X654TY7NKJXQHZZ5TA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805730364 (25h29m52.589070463s) [noise=true , address=185.167.204.205:4035 , piece_id=E6EQRUEBXNBLSY7MYHBU4ZLMASLFMHW6EYQV7XCJGBCWUGSLCFFQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805915377 (25h29m52.589255466s) [noise=true , address=185.167.204.205:4014 , piece_id=BBV7YAA34BVWKO3MDENOBCNZRPI7OR62OL35D3XPHXZ66IDAUWPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805932159 (25h29m52.589272258s) [noise=true , address=185.167.204.205:4002 , piece_id=NGMYOKOP5QTTUSLIAJHRB43TLBYQFRCSBM6U26BZBXLKA2ENTIQA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806082816 (25h29m52.589422915s) [noise=true , address=185.167.204.206:4065 , piece_id=EIGTOJDLRXTIY2HATT22TIN2TF7M7UIXZDMRSMFMYBHHTLHE5KBA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806120208 (25h29m52.589460327s) [noise=true , address=185.167.204.206:4072 , piece_id=XR5UOQJMCKXCZ7BUFKO3HLS57RPG6SLH2S2RSO4KEE7PBAL5US3Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806248693 (25h29m52.589588792s) [noise=true , address=185.167.204.205:4023 , piece_id=PQFGRQSVJ4ZLC5GYQTOXIURXJRPODTLPK36BQISX66L7LUC5ZSBQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:41840->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806423337 (25h29m52.589763426s) [noise=true , address=185.167.204.205:4021 , piece_id=HYN6CWTC3KLSDUQUZ2AWWFB4TVY5SPH4SMT3VHM62NAXHVFH6JEA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806471758 (25h29m52.589811857s) [noise=true , address=185.167.204.206:4056 , piece_id=HT6UEZP55TVKRHY2NEWXYXYC456BSVYHVJ2PIAOSICUDH5UZDKMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806497608 (25h29m52.589837707s) [noise=true , address=185.167.204.206:4041 , piece_id=G3NXN2TLCIFTC4B7FFL7VLHFVKWDNLBXA6BLRDDKAWRKUZE34BYQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806627034 (25h29m52.589967134s) [noise=true , address=185.167.204.206:4052 , piece_id=2OU6DVHU6K4HUJJ6K6I52DYAC5XPBNBGZFFJ4LAAYJZLYZEM26FA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; context deadline exceeded May 26 03:34:06.806767703 (25h29m52.590107792s) [noise=true , address=185.167.204.206:4063 , piece_id=GZKUBYQZSIFP53QKGBI3R3V52SEY7AWHEL5CBVMTWWSIHCP5HKEQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: context deadline exceeded; context deadline exceeded May 26 03:34:06.806787201 (25h29m52.5901273s) [seg_pos={0 0}, upload=24372]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> May 26 03:34:06.983344969 (25h29m52.766685058s) [upload=24372]: Done uploading segments... May 26 03:34:06.983374684 (25h29m52.766714783s) [upload=24372]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 4.651404054s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 4.08187387s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:35:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.081902815s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 4.111359773s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:34:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.11137908s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 4.707255289s trace: https://jaeger.dev.storj.io/trace/58499abd97a4a547 FAIL (2026-05-26 03:34:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:07.482929983 (25h28m53.266270072s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:08.324361378 (25h28m54.107701477s) [upload=24372]: Next returned nil segment May 26 03:33:08.324374614 (25h28m54.107714703s) [upload=24372]: Waiting for error group managing segments... May 26 03:33:08.731031075 (25h28m54.514371174s) [noise=true , address=81.171.14.70:4039 , piece_id=GFPLM7V2D4I2XSTWNIU3322NH4RNAD33QI3GVP3N7WDWG3DUU64Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731274119 (25h28m54.514614218s) [noise=true , address=81.171.14.70:4026 , piece_id=ZQLJIJPHJ2KP65YOMMZNILTNR6WYYHSVSPKBU4WKFTOQFNI3VCVQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731699240 (25h28m54.515039339s) [noise=true , address=81.171.14.70:4048 , piece_id=7B5HNGMTIYVRA3YBRXPX5UN4YLKA47SA3VEA6V5VKTE5HKNKRXZQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.740303036 (25h28m54.523643126s) [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.746923018 (25h28m54.530263107s) [noise=true , address=81.171.14.70:4042 , piece_id=WXRNES7VUHBWFEBLVPJFHOMCB36C35BRZOPIDKY37EC3XL272H4Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.787794853 (25h28m54.571134952s) [noise=true , address=81.171.14.70:4041 , piece_id=GALIU56QSLRKVUA4PPLGYWFR7TLDCHJMWM6ZFSYXBIZE2T3NKE5A, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.223068517 (25h28m55.006408616s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.230623161 (25h28m55.01396326s) [noise=true , address=81.171.14.70:4043 , piece_id=NMZQKARJH6BVDK6HCQTR7AUTY6SFTQM7J5FA37ZYNMEPY3PBPZTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.231318919 (25h28m55.014659018s) [noise=true , address=89.149.201.147:4011 , piece_id=HRINJWZ55AT43T7YKNCXU3WJIGLOD6WS63YV4NNL6AYS35XRCXFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.234455043 (25h28m55.017795142s) [noise=true , address=89.149.201.147:4021 , piece_id=QM5OZORHMNRUTV7BNXUZN66UKFN3FU4HBJ7JJ6BY42GAR65SVDMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.250660443 (25h28m55.034000542s) [noise=true , address=89.149.201.147:4017 , piece_id=MXYGBV5XQEM3RWWSWWWVNJMGH2UJGT2IFPDSNQX5DPWGGACKJHTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.280697715 (25h28m55.064037814s) [noise=true , address=89.149.201.147:4009 , piece_id=Q2FKJYIANL7NYOY4F7JGJK6SU5MUSLYUZ7FGWG26CFTA4FHJXGSQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.305574250 (25h28m55.088914349s) [noise=true , address=89.149.201.147:4020 , piece_id=BWDGFP3HHL4DJTNA4RZHGHKJKSKIRKNXQCXFKLA3CQNC56IW7CRA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.326442828 (25h28m55.109782927s) [noise=true , address=89.149.201.147:4014 , piece_id=Z3ONVFREJGQVKARJMVY3XDZ5DFQUYCG32I2MYSRXYHPVWGHBDCVA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.371048036 (25h28m55.154388125s) [noise=true , address=89.149.201.147:4010 , piece_id=7WWA7ZEMEEVSLO2A43ABF72GBXM7K7RFU4AIBRCUZKN2Z6ICSGPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:34:06.805550190 (25h29m52.58889029s) [noise=true , address=185.167.204.205:4027 , piece_id=OXLJIIPWJHYL6JJMFP3A7554T4IZK6MCFNDVEY4QWSVEXJ6TIQYA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805635323 (25h29m52.588975472s) [noise=true , address=185.167.204.206:4050 , piece_id=4F7GNQFFMNVYG3NEN6WYMFCKSQJJHPAWF6X654TY7NKJXQHZZ5TA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805730364 (25h29m52.589070463s) [noise=true , address=185.167.204.205:4035 , piece_id=E6EQRUEBXNBLSY7MYHBU4ZLMASLFMHW6EYQV7XCJGBCWUGSLCFFQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805915377 (25h29m52.589255466s) [noise=true , address=185.167.204.205:4014 , piece_id=BBV7YAA34BVWKO3MDENOBCNZRPI7OR62OL35D3XPHXZ66IDAUWPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805932159 (25h29m52.589272258s) [noise=true , address=185.167.204.205:4002 , piece_id=NGMYOKOP5QTTUSLIAJHRB43TLBYQFRCSBM6U26BZBXLKA2ENTIQA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806082816 (25h29m52.589422915s) [noise=true , address=185.167.204.206:4065 , piece_id=EIGTOJDLRXTIY2HATT22TIN2TF7M7UIXZDMRSMFMYBHHTLHE5KBA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806120208 (25h29m52.589460327s) [noise=true , address=185.167.204.206:4072 , piece_id=XR5UOQJMCKXCZ7BUFKO3HLS57RPG6SLH2S2RSO4KEE7PBAL5US3Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806248693 (25h29m52.589588792s) [noise=true , address=185.167.204.205:4023 , piece_id=PQFGRQSVJ4ZLC5GYQTOXIURXJRPODTLPK36BQISX66L7LUC5ZSBQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:41840->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806423337 (25h29m52.589763426s) [noise=true , address=185.167.204.205:4021 , piece_id=HYN6CWTC3KLSDUQUZ2AWWFB4TVY5SPH4SMT3VHM62NAXHVFH6JEA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806471758 (25h29m52.589811857s) [noise=true , address=185.167.204.206:4056 , piece_id=HT6UEZP55TVKRHY2NEWXYXYC456BSVYHVJ2PIAOSICUDH5UZDKMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806497608 (25h29m52.589837707s) [noise=true , address=185.167.204.206:4041 , piece_id=G3NXN2TLCIFTC4B7FFL7VLHFVKWDNLBXA6BLRDDKAWRKUZE34BYQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806627034 (25h29m52.589967134s) [noise=true , address=185.167.204.206:4052 , piece_id=2OU6DVHU6K4HUJJ6K6I52DYAC5XPBNBGZFFJ4LAAYJZLYZEM26FA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; context deadline exceeded May 26 03:34:06.806767703 (25h29m52.590107792s) [noise=true , address=185.167.204.206:4063 , piece_id=GZKUBYQZSIFP53QKGBI3R3V52SEY7AWHEL5CBVMTWWSIHCP5HKEQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: context deadline exceeded; context deadline exceeded May 26 03:34:06.806787201 (25h29m52.5901273s) [seg_pos={0 0}, upload=24372]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> May 26 03:34:06.983344969 (25h29m52.766685058s) [upload=24372]: Done uploading segments... May 26 03:34:06.983374684 (25h29m52.766714783s) [upload=24372]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 4.707278201s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.088593644s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:34:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.088615797s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.103832275s trace: https://jaeger.dev.storj.io/trace/58499abd97a4a547 FAIL (2026-05-26 03:34:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:07.482929983 (25h28m53.266270072s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:08.324361378 (25h28m54.107701477s) [upload=24372]: Next returned nil segment May 26 03:33:08.324374614 (25h28m54.107714703s) [upload=24372]: Waiting for error group managing segments... May 26 03:33:08.731031075 (25h28m54.514371174s) [noise=true , address=81.171.14.70:4039 , piece_id=GFPLM7V2D4I2XSTWNIU3322NH4RNAD33QI3GVP3N7WDWG3DUU64Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731274119 (25h28m54.514614218s) [noise=true , address=81.171.14.70:4026 , piece_id=ZQLJIJPHJ2KP65YOMMZNILTNR6WYYHSVSPKBU4WKFTOQFNI3VCVQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731699240 (25h28m54.515039339s) [noise=true , address=81.171.14.70:4048 , piece_id=7B5HNGMTIYVRA3YBRXPX5UN4YLKA47SA3VEA6V5VKTE5HKNKRXZQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.740303036 (25h28m54.523643126s) [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.746923018 (25h28m54.530263107s) [noise=true , address=81.171.14.70:4042 , piece_id=WXRNES7VUHBWFEBLVPJFHOMCB36C35BRZOPIDKY37EC3XL272H4Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.787794853 (25h28m54.571134952s) [noise=true , address=81.171.14.70:4041 , piece_id=GALIU56QSLRKVUA4PPLGYWFR7TLDCHJMWM6ZFSYXBIZE2T3NKE5A, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.223068517 (25h28m55.006408616s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.230623161 (25h28m55.01396326s) [noise=true , address=81.171.14.70:4043 , piece_id=NMZQKARJH6BVDK6HCQTR7AUTY6SFTQM7J5FA37ZYNMEPY3PBPZTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.231318919 (25h28m55.014659018s) [noise=true , address=89.149.201.147:4011 , piece_id=HRINJWZ55AT43T7YKNCXU3WJIGLOD6WS63YV4NNL6AYS35XRCXFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.234455043 (25h28m55.017795142s) [noise=true , address=89.149.201.147:4021 , piece_id=QM5OZORHMNRUTV7BNXUZN66UKFN3FU4HBJ7JJ6BY42GAR65SVDMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.250660443 (25h28m55.034000542s) [noise=true , address=89.149.201.147:4017 , piece_id=MXYGBV5XQEM3RWWSWWWVNJMGH2UJGT2IFPDSNQX5DPWGGACKJHTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.280697715 (25h28m55.064037814s) [noise=true , address=89.149.201.147:4009 , piece_id=Q2FKJYIANL7NYOY4F7JGJK6SU5MUSLYUZ7FGWG26CFTA4FHJXGSQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.305574250 (25h28m55.088914349s) [noise=true , address=89.149.201.147:4020 , piece_id=BWDGFP3HHL4DJTNA4RZHGHKJKSKIRKNXQCXFKLA3CQNC56IW7CRA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.326442828 (25h28m55.109782927s) [noise=true , address=89.149.201.147:4014 , piece_id=Z3ONVFREJGQVKARJMVY3XDZ5DFQUYCG32I2MYSRXYHPVWGHBDCVA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.371048036 (25h28m55.154388125s) [noise=true , address=89.149.201.147:4010 , piece_id=7WWA7ZEMEEVSLO2A43ABF72GBXM7K7RFU4AIBRCUZKN2Z6ICSGPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:34:06.805550190 (25h29m52.58889029s) [noise=true , address=185.167.204.205:4027 , piece_id=OXLJIIPWJHYL6JJMFP3A7554T4IZK6MCFNDVEY4QWSVEXJ6TIQYA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805635323 (25h29m52.588975472s) [noise=true , address=185.167.204.206:4050 , piece_id=4F7GNQFFMNVYG3NEN6WYMFCKSQJJHPAWF6X654TY7NKJXQHZZ5TA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805730364 (25h29m52.589070463s) [noise=true , address=185.167.204.205:4035 , piece_id=E6EQRUEBXNBLSY7MYHBU4ZLMASLFMHW6EYQV7XCJGBCWUGSLCFFQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805915377 (25h29m52.589255466s) [noise=true , address=185.167.204.205:4014 , piece_id=BBV7YAA34BVWKO3MDENOBCNZRPI7OR62OL35D3XPHXZ66IDAUWPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805932159 (25h29m52.589272258s) [noise=true , address=185.167.204.205:4002 , piece_id=NGMYOKOP5QTTUSLIAJHRB43TLBYQFRCSBM6U26BZBXLKA2ENTIQA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806082816 (25h29m52.589422915s) [noise=true , address=185.167.204.206:4065 , piece_id=EIGTOJDLRXTIY2HATT22TIN2TF7M7UIXZDMRSMFMYBHHTLHE5KBA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806120208 (25h29m52.589460327s) [noise=true , address=185.167.204.206:4072 , piece_id=XR5UOQJMCKXCZ7BUFKO3HLS57RPG6SLH2S2RSO4KEE7PBAL5US3Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806248693 (25h29m52.589588792s) [noise=true , address=185.167.204.205:4023 , piece_id=PQFGRQSVJ4ZLC5GYQTOXIURXJRPODTLPK36BQISX66L7LUC5ZSBQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:41840->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806423337 (25h29m52.589763426s) [noise=true , address=185.167.204.205:4021 , piece_id=HYN6CWTC3KLSDUQUZ2AWWFB4TVY5SPH4SMT3VHM62NAXHVFH6JEA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806471758 (25h29m52.589811857s) [noise=true , address=185.167.204.206:4056 , piece_id=HT6UEZP55TVKRHY2NEWXYXYC456BSVYHVJ2PIAOSICUDH5UZDKMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806497608 (25h29m52.589837707s) [noise=true , address=185.167.204.206:4041 , piece_id=G3NXN2TLCIFTC4B7FFL7VLHFVKWDNLBXA6BLRDDKAWRKUZE34BYQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806627034 (25h29m52.589967134s) [noise=true , address=185.167.204.206:4052 , piece_id=2OU6DVHU6K4HUJJ6K6I52DYAC5XPBNBGZFFJ4LAAYJZLYZEM26FA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; context deadline exceeded May 26 03:34:06.806767703 (25h29m52.590107792s) [noise=true , address=185.167.204.206:4063 , piece_id=GZKUBYQZSIFP53QKGBI3R3V52SEY7AWHEL5CBVMTWWSIHCP5HKEQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: context deadline exceeded; context deadline exceeded May 26 03:34:06.806787201 (25h29m52.5901273s) [seg_pos={0 0}, upload=24372]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> May 26 03:34:06.983344969 (25h29m52.766685058s) [upload=24372]: Done uploading segments... May 26 03:34:06.983374684 (25h29m52.766714783s) [upload=24372]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 5.103843318s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.179905174s trace: https://jaeger.dev.storj.io/trace/58499abd97a4a547 FAIL (2026-05-26 03:34:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 15) ======LOGS====== [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:07.482929983 (25h28m53.266270072s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Uploading piece... May 26 03:33:08.324361378 (25h28m54.107701477s) [upload=24372]: Next returned nil segment May 26 03:33:08.324374614 (25h28m54.107714703s) [upload=24372]: Waiting for error group managing segments... May 26 03:33:08.731031075 (25h28m54.514371174s) [noise=true , address=81.171.14.70:4039 , piece_id=GFPLM7V2D4I2XSTWNIU3322NH4RNAD33QI3GVP3N7WDWG3DUU64Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731274119 (25h28m54.514614218s) [noise=true , address=81.171.14.70:4026 , piece_id=ZQLJIJPHJ2KP65YOMMZNILTNR6WYYHSVSPKBU4WKFTOQFNI3VCVQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.731699240 (25h28m54.515039339s) [noise=true , address=81.171.14.70:4048 , piece_id=7B5HNGMTIYVRA3YBRXPX5UN4YLKA47SA3VEA6V5VKTE5HKNKRXZQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.740303036 (25h28m54.523643126s) [noise=true , address=81.171.14.70:4033 , piece_id=YI6PF2NM7LLPZZ42TCKBLGTHJNPJADH5XUURGJI4G2ITEIASGCFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.746923018 (25h28m54.530263107s) [noise=true , address=81.171.14.70:4042 , piece_id=WXRNES7VUHBWFEBLVPJFHOMCB36C35BRZOPIDKY37EC3XL272H4Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:08.787794853 (25h28m54.571134952s) [noise=true , address=81.171.14.70:4041 , piece_id=GALIU56QSLRKVUA4PPLGYWFR7TLDCHJMWM6ZFSYXBIZE2T3NKE5A, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.223068517 (25h28m55.006408616s) [noise=true , address=81.171.14.70:4044 , piece_id=JUVFW2SHNIMCED7Y4S22YJQ246TIUUOY2SCF3HYMOQNKDV2ORPUA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.230623161 (25h28m55.01396326s) [noise=true , address=81.171.14.70:4043 , piece_id=NMZQKARJH6BVDK6HCQTR7AUTY6SFTQM7J5FA37ZYNMEPY3PBPZTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.231318919 (25h28m55.014659018s) [noise=true , address=89.149.201.147:4011 , piece_id=HRINJWZ55AT43T7YKNCXU3WJIGLOD6WS63YV4NNL6AYS35XRCXFA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.234455043 (25h28m55.017795142s) [noise=true , address=89.149.201.147:4021 , piece_id=QM5OZORHMNRUTV7BNXUZN66UKFN3FU4HBJ7JJ6BY42GAR65SVDMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.250660443 (25h28m55.034000542s) [noise=true , address=89.149.201.147:4017 , piece_id=MXYGBV5XQEM3RWWSWWWVNJMGH2UJGT2IFPDSNQX5DPWGGACKJHTA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.280697715 (25h28m55.064037814s) [noise=true , address=89.149.201.147:4009 , piece_id=Q2FKJYIANL7NYOY4F7JGJK6SU5MUSLYUZ7FGWG26CFTA4FHJXGSQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.305574250 (25h28m55.088914349s) [noise=true , address=89.149.201.147:4020 , piece_id=BWDGFP3HHL4DJTNA4RZHGHKJKSKIRKNXQCXFKLA3CQNC56IW7CRA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.326442828 (25h28m55.109782927s) [noise=true , address=89.149.201.147:4014 , piece_id=Z3ONVFREJGQVKARJMVY3XDZ5DFQUYCG32I2MYSRXYHPVWGHBDCVA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:33:09.371048036 (25h28m55.154388125s) [noise=true , address=89.149.201.147:4010 , piece_id=7WWA7ZEMEEVSLO2A43ABF72GBXM7K7RFU4AIBRCUZKN2Z6ICSGPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: <nil> May 26 03:34:06.805550190 (25h29m52.58889029s) [noise=true , address=185.167.204.205:4027 , piece_id=OXLJIIPWJHYL6JJMFP3A7554T4IZK6MCFNDVEY4QWSVEXJ6TIQYA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: rpc: dial tcp 185.167.204.205:4027: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805635323 (25h29m52.588975472s) [noise=true , address=185.167.204.206:4050 , piece_id=4F7GNQFFMNVYG3NEN6WYMFCKSQJJHPAWF6X654TY7NKJXQHZZ5TA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz, address:185.167.204.206:4050): protocol: rpc: dial tcp 185.167.204.206:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805730364 (25h29m52.589070463s) [noise=true , address=185.167.204.205:4035 , piece_id=E6EQRUEBXNBLSY7MYHBU4ZLMASLFMHW6EYQV7XCJGBCWUGSLCFFQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805915377 (25h29m52.589255466s) [noise=true , address=185.167.204.205:4014 , piece_id=BBV7YAA34BVWKO3MDENOBCNZRPI7OR62OL35D3XPHXZ66IDAUWPQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.805932159 (25h29m52.589272258s) [noise=true , address=185.167.204.205:4002 , piece_id=NGMYOKOP5QTTUSLIAJHRB43TLBYQFRCSBM6U26BZBXLKA2ENTIQA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806082816 (25h29m52.589422915s) [noise=true , address=185.167.204.206:4065 , piece_id=EIGTOJDLRXTIY2HATT22TIN2TF7M7UIXZDMRSMFMYBHHTLHE5KBA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806120208 (25h29m52.589460327s) [noise=true , address=185.167.204.206:4072 , piece_id=XR5UOQJMCKXCZ7BUFKO3HLS57RPG6SLH2S2RSO4KEE7PBAL5US3Q, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806248693 (25h29m52.589588792s) [noise=true , address=185.167.204.205:4023 , piece_id=PQFGRQSVJ4ZLC5GYQTOXIURXJRPODTLPK36BQISX66L7LUC5ZSBQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: write tcp 188.166.225.170:41840->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806423337 (25h29m52.589763426s) [noise=true , address=185.167.204.205:4021 , piece_id=HYN6CWTC3KLSDUQUZ2AWWFB4TVY5SPH4SMT3VHM62NAXHVFH6JEA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: rpc: dial tcp 185.167.204.205:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806471758 (25h29m52.589811857s) [noise=true , address=185.167.204.206:4056 , piece_id=HT6UEZP55TVKRHY2NEWXYXYC456BSVYHVJ2PIAOSICUDH5UZDKMQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1uSTuNA28oH2s5Rkv2jaKoC2nZWSgpMJXyxwFTCKbr44EvEXrC, address:185.167.204.206:4056): protocol: rpc: dial tcp 185.167.204.206:4056: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806497608 (25h29m52.589837707s) [noise=true , address=185.167.204.206:4041 , piece_id=G3NXN2TLCIFTC4B7FFL7VLHFVKWDNLBXA6BLRDDKAWRKUZE34BYQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op May 26 03:34:06.806627034 (25h29m52.589967134s) [noise=true , address=185.167.204.206:4052 , piece_id=2OU6DVHU6K4HUJJ6K6I52DYAC5XPBNBGZFFJ4LAAYJZLYZEM26FA, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; context deadline exceeded May 26 03:34:06.806767703 (25h29m52.590107792s) [noise=true , address=185.167.204.206:4063 , piece_id=GZKUBYQZSIFP53QKGBI3R3V52SEY7AWHEL5CBVMTWWSIHCP5HKEQ, seg_pos={0 0}, upload=24372]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: context deadline exceeded; context deadline exceeded May 26 03:34:06.806787201 (25h29m52.5901273s) [seg_pos={0 0}, upload=24372]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil> May 26 03:34:06.983344969 (25h29m52.766685058s) [upload=24372]: Done uploading segments... May 26 03:34:06.983374684 (25h29m52.766714783s) [upload=24372]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15) Duration: 1m0.179915293s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.009548153s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:33:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.009569092s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 4.042787634s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:32:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.042811299s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.049349243s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:31:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.049362399s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 4.088059938s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:30:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.088090937s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 18.6170133s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:29:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 18.617031284s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 3.986870732s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:28:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 3.986893335s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.46850341s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:28:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 5.468526144s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [X...................................................X.......] duration: 4.065668863s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:28:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.065691565s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.X...................................................X......] duration: 27.849122328s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:27:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 27.84914451s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..X...................................................X.....] duration: 4.106067135s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:26:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.106091511s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...X...................................................X....] duration: 5.766957699s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:26:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 5.766981445s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....X...................................................X...] duration: 4.085772923s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:25:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.085786989s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....X...................................................X..] duration: 4.084662453s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:23:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.084685056s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......X...................................................X.] duration: 4.098438937s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:23:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 4.098451921s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......X...................................................X] duration: 1m0.001713949s trace: https://jaeger.dev.storj.io/trace/4c3f248186c2d3ce FAIL (2026-05-26 03:23:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== RA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.717690664 (25h18m33.501030773s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718219783 (25h18m33.501559902s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.718696192 (25h18m33.502036301s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719102697 (25h18m33.502442796s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719525554 (25h18m33.502865663s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.719864662 (25h18m33.503204761s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.721683923 (25h18m33.505024012s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.723523753 (25h18m33.506863852s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.725248023 (25h18m33.508588122s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.726676589 (25h18m33.510016698s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.728163856 (25h18m33.511503965s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.729474488 (25h18m33.512814587s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.730924224 (25h18m33.514264323s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.731278850 (25h18m33.514618959s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:47.732618056 (25h18m33.515958155s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Uploading piece... May 26 03:22:48.784492844 (25h18m34.567832933s) [upload=24202]: Next returned nil segment May 26 03:22:48.784509936 (25h18m34.567850035s) [upload=24202]: Waiting for error group managing segments... May 26 03:22:49.066112633 (25h18m34.849452732s) [noise=true , address=212.102.52.217:4418 , piece_id=5Q76DQXWAMMI4PDW4OUBKWYTIU4UV4AZC2423Q36AWSHEA4BQ5XA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.068209543 (25h18m34.851549642s) [noise=true , address=212.102.52.217:4432 , piece_id=I6EOXLLGEDOB6SZMAB5ZCGJR3JUB26HHV3RETZAVMCD4VUOXYVKQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.081505562 (25h18m34.864845661s) [noise=true , address=212.102.52.213:4340 , piece_id=76BNRFUFLD5QGB64N7XMI5L64DP5UHTUQ3UAGZH7D6SZERV5KYVA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.086628668 (25h18m34.869968767s) [noise=true , address=212.102.52.215:4376 , piece_id=2FVMZOYWDH5CXZ2XKDIABIDYAZPVH5DUPABJQAMQ7F5SKELXJAGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.087886768 (25h18m34.871226867s) [noise=true , address=212.102.52.215:4369 , piece_id=ZD667M5QYIOZXZR3VEWMIK7APGCX67ZUHSXNOJRQAI26F3OAQGGQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.089549981 (25h18m34.87289007s) [noise=true , address=212.102.52.214:4353 , piece_id=425JO2O2UFV2VR2YIYJ2LHRUO7ECRCW4F2AQZP5H4HJLHDXRGQNQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.090604734 (25h18m34.873944833s) [noise=true , address=212.102.52.216:4409 , piece_id=A6V2NMQ7A5PZEC25VIBIKOAJBQGMBJSNZRCYUU2LHKCT6MGYC67A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.091932537 (25h18m34.875272626s) [noise=true , address=212.102.52.217:4431 , piece_id=TISKS2ETP7VDHORY5WVDAOBTFIKGGRM5HZSUIV4YSTYWYFJJIOSA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.092696696 (25h18m34.876036795s) [noise=true , address=212.102.52.216:4407 , piece_id=UITPTQJGERBDAZ4KFG26GXSAKIO4LRXAJHR2MUSTVNHHHAIEQWDA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.095404642 (25h18m34.878744731s) [noise=true , address=212.102.52.216:4395 , piece_id=OSM7QXDXXGPI6ROCTDUP4ZBF7GXJ3K3HGS66CYZWJHGFDXPXQPXQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.097592727 (25h18m34.880932816s) [noise=true , address=212.102.52.215:4372 , piece_id=XDNDGGRVV5SHULUOQYATL5MQKBHQM34TRGSJOG2BVT6HXB3PHMMQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.102984134 (25h18m34.886324233s) [noise=true , address=212.102.52.213:4328 , piece_id=DORT7J2NVGOETGFW4XBQOQMAKMS6R5C2SJPYQIRPIJGWPTZWSRAQ, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.119360932 (25h18m34.902701031s) [noise=true , address=212.102.52.214:4346 , piece_id=OUL6U5MOOY5GWYTVFWEY2NST7MVEH2AYJS4PSK4WYCWDY232JOGA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.124623182 (25h18m34.907963281s) [noise=true , address=212.102.52.213:4343 , piece_id=QRNX6HNX7NOANW3VZBQ3SHFJXPRMGQ6UNMAEWAT4P3VCTJSQQNTA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.145477533 (25h18m34.928817622s) [noise=true , address=212.102.52.216:4396 , piece_id=XSNLB63RN6HLG7ZY5TBRYEXE3BWOPLIANEBTZ7N3FQLZU2CBUM2Q, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147033100 (25h18m34.9303732s) [noise=true , address=212.102.52.214:4349 , piece_id=DEWQF5II4URQU3M7Q37PLFGZPBUJHIMANKAXP3UHAX6HUPDX5C5A, seg_pos={0 0}, upload=24202]: Done uploading piece. err: <nil> May 26 03:22:49.147084960 (25h18m34.930425059s) [seg_pos={0 0}, upload=24202]: Satisfied cohort requirements after 16 pieces May 26 03:22:49.147306913 (25h18m34.930647012s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147314428 (25h18m34.930654527s) [noise=true , address=212.102.52.217:4426 , piece_id=BZNX5TNR2ZTCA2FBDLYSFGH7YVAMYJZ34JZP6PXGMPOIFS6MH3UA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147381165 (25h18m34.930721264s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BL6sUUowTDCFa3Zu7Xv5SheJRFGzEHVd1yq3goxmvT5WggLg4): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147530881 (25h18m34.93087098s) [noise=true , address=212.102.52.215:4378 , piece_id=YL4LQ4NUNYCGOLA4275NHQ2QEYSJXH4N45KQXOWD2QWPRXGV7CCA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147694833 (25h18m34.931034932s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWtfxMCjFReYLn1h8D7anfnQJvqr5rxwPJ4aVqMbiq3awn94S): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147700645 (25h18m34.931040744s) [noise=true , address=212.102.52.214:4365 , piece_id=LN5TMSMYVDTS3ZQKY6E3QKRR54IYVQQXCPXUAAYD5IX6CHEDJCRA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147706737 (25h18m34.931046836s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S6X8KXb1nqoCXzKBNMKxsiaQp5e5iUBDVhor5it7U4azZx4Wu): protocol: expected piece hash; context canceled; EOF May 26 03:22:49.147713549 (25h18m34.931053648s) [noise=true , address=212.102.52.213:4334 , piece_id=2VCK72UV2KCIEBENX7IV2UJ5YR3AWXWEC42DRUB2PYF57LNQ7SLA, seg_pos={0 0}, upload=24202]: Long tail cancellation due to optimal threshold May 26 03:22:49.147733618 (25h18m34.931073717s) [seg_pos={0 0}, upload=24202]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 03:22:49.147796518 (25h18m34.931136617s) [upload=24202]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 03:22:49.147800696 (25h18m34.931140795s) [upload=24202]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 03:23:03.163273999 (25h18m48.946614098s) [upload=24202]: Done uploading segments... May 26 03:23:03.163291522 (25h18m48.946631621s) [upload=24202]: Upload finished. err: <nil> Duration: 1m0.001726282s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 8.496066026s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:22:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 8.496083341s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.971352708s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:21:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 3.971372816s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.192603538s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:21:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.192625078s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.128088674s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:20:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.128111606s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.069115522s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:19:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.069134909s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.067074904s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:18:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.067095805s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.097689567s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:17:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 5.097701309s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.221573877s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:17:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 6.221595128s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 3.929019898s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:16:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 3.929054503s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.132049663s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:15:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.132066435s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 3.921458339s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:15:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 3.921472877s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.121756145s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:15:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.121768388s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.090285425s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:14:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.090309851s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.013513262s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:13:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.013535765s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.558648224s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:12:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 5.558668443s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 30.063134934s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:12:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 30.063156255s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.081193736s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:11:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.081216348s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 7.710583826s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:10:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 7.710606087s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.183951975s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:09:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 5.183977845s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.439428106s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:09:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.439439929s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 47.58666736s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:09:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 47.586682239s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.209040537s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:07:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.20905144s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 4.303411261s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:06:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.303429909s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 4.204462538s trace: https://jaeger.dev.storj.io/trace/17aceacd274ea904 FAIL (2026-05-26 03:05:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== WOMMSQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285041770 (24h40m51.068381869s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285317366 (24h40m51.068657465s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285382941 (24h40m51.06872304s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285567323 (24h40m51.068907422s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285686490 (24h40m51.069026589s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285818412 (24h40m51.069158511s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.285985852 (24h40m51.069325951s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286066956 (24h40m51.069407045s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286262059 (24h40m51.069602158s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286334366 (24h40m51.069674465s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286561049 (24h40m51.069901148s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.286793283 (24h40m51.070133382s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287220257 (24h40m51.070560366s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.287714570 (24h40m51.071054669s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:05.288056672 (24h40m51.071396771s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Uploading piece... May 26 02:45:06.349712539 (24h40m52.133052638s) [upload=23586]: Next returned nil segment May 26 02:45:06.349726104 (24h40m52.133066203s) [upload=23586]: Waiting for error group managing segments... May 26 02:45:06.630461432 (24h40m52.413801531s) [noise=true , address=212.102.52.213:4325 , piece_id=MGAE5UPXRRW77XZRK6BAPZJIFRSCDQYVT3GNAPTWKIFDRECTPQ3Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.635982606 (24h40m52.419322705s) [noise=true , address=212.102.52.214:4346 , piece_id=NHDTKA36E3NVGD7BLVRU64H5NHRJJXTRSJDLQAOYMYSPKJZYMIGA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636825054 (24h40m52.420165153s) [noise=true , address=212.102.52.213:4336 , piece_id=7ID4QBAPSQU3MUFZHDN3VARIT35RGMUAJNTIQKMM6OFAFNRCAHBQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.636948539 (24h40m52.420288639s) [noise=true , address=212.102.52.214:4359 , piece_id=EXXQEDCZQVV6VCUFTDM3FHV6UZVWM576D3GVU73F2OKEF7HQOK6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.637195581 (24h40m52.42053567s) [noise=true , address=212.102.52.216:4412 , piece_id=XAGTPN62JSRQKIIV52ZIZYP4CSCUHSMBQ6EUYYNCCNTXDGWOMMSQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.642989476 (24h40m52.426329575s) [noise=true , address=212.102.52.217:4421 , piece_id=USF7HRE7PZJ6P54VGPLXBQTVUDU7EW6JKPFO6Z4HT5WVFPGFWJGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.643855387 (24h40m52.427195486s) [noise=true , address=212.102.52.216:4405 , piece_id=FIMA6GCMWA55BZKXDYZ4MXVID4Z5VRESIY3DQ3M4NZGGWMV32KGQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.646613610 (24h40m52.429953709s) [noise=true , address=212.102.52.217:4419 , piece_id=MPJO5SEUVO56X2FBMIY2QIJDSUCGQDFSQIVMCKOLZFBP36UIN3JA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.649584028 (24h40m52.432924127s) [noise=true , address=212.102.52.214:4355 , piece_id=JSM4FZDMRPOWFWMHXQ34J5HG2FVT73JI53HVK7HOLB4E745FJDLA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.652171885 (24h40m52.435511984s) [noise=true , address=212.102.52.213:4341 , piece_id=2ZWYR4Z2DZBTZAYMLIIZBTTKBWHJNN2WPVFP7KH7WIAOZRBFYKKQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.654499687 (24h40m52.437839786s) [noise=true , address=212.102.52.215:4370 , piece_id=WXC4SVVPXEUKFOKEWH4QJRZEHGT2O5YMHPBJ7YAHYVYUIJ5LUSDA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.657212433 (24h40m52.440552532s) [noise=true , address=212.102.52.215:4369 , piece_id=BPAQMXMW352RS4OKCFEJT3KE4QU7Y27UBUQ3UPOKJE7UCU6NAJ4Q, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.659244420 (24h40m52.442584519s) [noise=true , address=212.102.52.213:4333 , piece_id=M5VJL5VRB5KGZA7ELIKPSMCK64KV4QC7F2B63DEJL3ARSV6YHW2A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.662907449 (24h40m52.446247548s) [noise=true , address=212.102.52.216:4401 , piece_id=YD4RU2GUOH5XFAULXYC7GSEYDTN3UZDUVURPYNPWPUQKTCLJDBCA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.663463611 (24h40m52.44680371s) [noise=true , address=212.102.52.217:4425 , piece_id=BYNNSHDGFU72GUGEZ5UAXTLMI3BALGMNYHCQQJYKUJAUXFAC3UUQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665609565 (24h40m52.448949674s) [noise=true , address=212.102.52.214:4358 , piece_id=OZIDDRPW3YKK4QJBS2EJ54VLCIASMTGJOECAEXCVZW2KXRZIFTBA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: <nil> May 26 02:45:06.665624012 (24h40m52.448964121s) [seg_pos={0 0}, upload=23586]: Satisfied cohort requirements after 16 pieces May 26 02:45:06.665840606 (24h40m52.449180705s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665848962 (24h40m52.449189061s) [noise=true , address=212.102.52.216:4403 , piece_id=CEK4JLVJLX2ZC2B2CAWPCMV4AWAFEIUNGJAD2YBRBSECOAQ54APA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.665929957 (24h40m52.449270056s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y7fgkR8bVb2KyytzjpKenEJVq3vrWEmbrVL9aMzc1ZfFjkURS): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.665939284 (24h40m52.449279383s) [noise=true , address=212.102.52.215:4384 , piece_id=5QHIFOLNUMEZIQ73OAOB35TCTKPXN62S4E4TSFE2STJYMTIVNQ6A, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666034085 (24h40m52.449374184s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666042912 (24h40m52.449383011s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvE57QpD9nEDyftRA5mZA5RDoDPScLWHuEm5bbSCbnr5hZb27): protocol: expected piece hash; context canceled; EOF May 26 02:45:06.666050236 (24h40m52.449390335s) [noise=true , address=212.102.52.217:4417 , piece_id=2BMD5P3MIDI77WWUPMN3KSB7WXU5OC2M46CIA23CQCIXTHGTLGWA, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666071887 (24h40m52.449411986s) [noise=true , address=212.102.52.215:4376 , piece_id=L7DXYDLDUSKG2YHXOHTLZTC7TCTOANEH7ZREPL5WPSIQQDEW5BCQ, seg_pos={0 0}, upload=23586]: Long tail cancellation due to optimal threshold May 26 02:45:06.666087968 (24h40m52.449428067s) [seg_pos={0 0}, upload=23586]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 02:45:06.666180585 (24h40m52.449520684s) [upload=23586]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 02:45:06.666190704 (24h40m52.449530803s) [upload=23586]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 02:45:21.794358311 (24h41m7.57769841s) [upload=23586]: Done uploading segments... May 26 02:45:21.794377978 (24h41m7.577718077s) [upload=23586]: Upload finished. err: <nil> Duration: 4.204501122s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)