Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......................X....X...........................X....] duration: 4.053369113s trace: https://jaeger.dev.storj.io/trace/34a3167c93e9d452 FAIL (2026-05-26 12:48:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3KJUWRAA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.173883418 (34h40m51.957223517s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174251000 (34h40m51.957591099s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174290935 (34h40m51.957631034s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174602551 (34h40m51.95794265s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174728671 (34h40m51.95806877s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174950454 (34h40m51.958290553s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175383791 (34h40m51.95872389s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175712058 (34h40m51.959052157s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176046917 (34h40m51.959387016s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176061394 (34h40m51.959401513s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176434937 (34h40m51.959775036s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176757021 (34h40m51.96009712s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176828588 (34h40m51.960168687s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176863154 (34h40m51.960203253s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.177161373 (34h40m51.960501472s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:07.250667406 (34h40m53.034007505s) [upload=33215]: Next returned nil segment May 26 12:45:07.250679949 (34h40m53.034020048s) [upload=33215]: Waiting for error group managing segments... May 26 12:45:07.531454635 (34h40m53.314794734s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534321906 (34h40m53.317662005s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534508562 (34h40m53.317848651s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.536279231 (34h40m53.31961934s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.541781561 (34h40m53.32512166s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.565752291 (34h40m53.34909239s) [noise=true , address=212.102.52.217:4436 , piece_id=4NDBERVDRZA62QUPGSB6YHKUDOUZJMHQRFO5ZATRI7DN32WA4BOA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566131584 (34h40m53.349471683s) [noise=true , address=212.102.52.215:4380 , piece_id=3AKIGLX2AF7QPQARHGKDD35S2WKTO77OP4CFVCJCCD4I3KJUWRAA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566578738 (34h40m53.349918837s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.572715768 (34h40m53.356055867s) [noise=true , address=212.102.52.216:4405 , piece_id=CYRXV67TFYNXLTSPPVHFKBHFLJ7SQUXVW6E7QJJVP2IO72JWK4DA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.573001394 (34h40m53.356341493s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578206936 (34h40m53.361547035s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578665933 (34h40m53.362006042s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578932330 (34h40m53.362272429s) [noise=true , address=212.102.52.213:4336 , piece_id=JHFA274T2DK5C4UMAPKWLMBB4ZLNBYTA4BYS2ZQ2KAHYO4LZAA4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.579487169 (34h40m53.362827268s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.581981168 (34h40m53.365321267s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584667704 (34h40m53.368007804s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584689156 (34h40m53.368029255s) [seg_pos={0 0}, upload=33215]: Satisfied cohort requirements after 16 pieces May 26 12:45:07.584881472 (34h40m53.368221581s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584891783 (34h40m53.368231882s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.584922872 (34h40m53.368262971s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584944583 (34h40m53.368284682s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585097405 (34h40m53.368437504s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MGexEpM3Yefmhe4mYARRJHvoGH4hNfULwt2uRgFs9fs18D9Md): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585119917 (34h40m53.368460016s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585152319 (34h40m53.368492428s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585162409 (34h40m53.368502518s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585248253 (34h40m53.368588362s) [seg_pos={0 0}, upload=33215]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:45:07.585325560 (34h40m53.368665659s) [upload=33215]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:45:07.585331842 (34h40m53.368671951s) [upload=33215]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:45:21.000413228 (34h41m6.783753337s) [upload=33215]: Done uploading segments... May 26 12:45:21.000428477 (34h41m6.783768586s) [upload=33215]: Upload finished. err: <nil> Duration: 4.053390204s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.......................X....X...........................X...] duration: 4.10124835s trace: https://jaeger.dev.storj.io/trace/34a3167c93e9d452 FAIL (2026-05-26 12:47:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3KJUWRAA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.173883418 (34h40m51.957223517s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174251000 (34h40m51.957591099s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174290935 (34h40m51.957631034s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174602551 (34h40m51.95794265s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174728671 (34h40m51.95806877s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174950454 (34h40m51.958290553s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175383791 (34h40m51.95872389s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175712058 (34h40m51.959052157s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176046917 (34h40m51.959387016s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176061394 (34h40m51.959401513s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176434937 (34h40m51.959775036s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176757021 (34h40m51.96009712s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176828588 (34h40m51.960168687s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176863154 (34h40m51.960203253s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.177161373 (34h40m51.960501472s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:07.250667406 (34h40m53.034007505s) [upload=33215]: Next returned nil segment May 26 12:45:07.250679949 (34h40m53.034020048s) [upload=33215]: Waiting for error group managing segments... May 26 12:45:07.531454635 (34h40m53.314794734s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534321906 (34h40m53.317662005s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534508562 (34h40m53.317848651s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.536279231 (34h40m53.31961934s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.541781561 (34h40m53.32512166s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.565752291 (34h40m53.34909239s) [noise=true , address=212.102.52.217:4436 , piece_id=4NDBERVDRZA62QUPGSB6YHKUDOUZJMHQRFO5ZATRI7DN32WA4BOA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566131584 (34h40m53.349471683s) [noise=true , address=212.102.52.215:4380 , piece_id=3AKIGLX2AF7QPQARHGKDD35S2WKTO77OP4CFVCJCCD4I3KJUWRAA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566578738 (34h40m53.349918837s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.572715768 (34h40m53.356055867s) [noise=true , address=212.102.52.216:4405 , piece_id=CYRXV67TFYNXLTSPPVHFKBHFLJ7SQUXVW6E7QJJVP2IO72JWK4DA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.573001394 (34h40m53.356341493s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578206936 (34h40m53.361547035s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578665933 (34h40m53.362006042s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578932330 (34h40m53.362272429s) [noise=true , address=212.102.52.213:4336 , piece_id=JHFA274T2DK5C4UMAPKWLMBB4ZLNBYTA4BYS2ZQ2KAHYO4LZAA4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.579487169 (34h40m53.362827268s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.581981168 (34h40m53.365321267s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584667704 (34h40m53.368007804s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584689156 (34h40m53.368029255s) [seg_pos={0 0}, upload=33215]: Satisfied cohort requirements after 16 pieces May 26 12:45:07.584881472 (34h40m53.368221581s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584891783 (34h40m53.368231882s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.584922872 (34h40m53.368262971s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584944583 (34h40m53.368284682s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585097405 (34h40m53.368437504s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MGexEpM3Yefmhe4mYARRJHvoGH4hNfULwt2uRgFs9fs18D9Md): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585119917 (34h40m53.368460016s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585152319 (34h40m53.368492428s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585162409 (34h40m53.368502518s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585248253 (34h40m53.368588362s) [seg_pos={0 0}, upload=33215]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:45:07.585325560 (34h40m53.368665659s) [upload=33215]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:45:07.585331842 (34h40m53.368671951s) [upload=33215]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:45:21.000413228 (34h41m6.783753337s) [upload=33215]: Done uploading segments... May 26 12:45:21.000428477 (34h41m6.783768586s) [upload=33215]: Upload finished. err: <nil> Duration: 4.101268758s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 6.987239172s trace: https://jaeger.dev.storj.io/trace/4c2f5e8c0d911bea FAIL (2026-05-26 12:47:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.987258979s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 3.908743146s trace: https://jaeger.dev.storj.io/trace/5867dddbed7af4dc FAIL (2026-05-26 12:47:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.908775658s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 3.859340688s trace: https://jaeger.dev.storj.io/trace/5867dddbed7af4dc FAIL (2026-05-26 12:47:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.859361006s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 6.752253417s trace: https://jaeger.dev.storj.io/trace/4c2f5e8c0d911bea FAIL (2026-05-26 12:47:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.752277473s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [........................X....X...........................X..] duration: 5.464070107s trace: https://jaeger.dev.storj.io/trace/34a3167c93e9d452 FAIL (2026-05-26 12:46:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3KJUWRAA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.173883418 (34h40m51.957223517s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174251000 (34h40m51.957591099s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174290935 (34h40m51.957631034s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174602551 (34h40m51.95794265s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174728671 (34h40m51.95806877s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174950454 (34h40m51.958290553s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175383791 (34h40m51.95872389s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175712058 (34h40m51.959052157s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176046917 (34h40m51.959387016s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176061394 (34h40m51.959401513s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176434937 (34h40m51.959775036s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176757021 (34h40m51.96009712s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176828588 (34h40m51.960168687s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176863154 (34h40m51.960203253s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.177161373 (34h40m51.960501472s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:07.250667406 (34h40m53.034007505s) [upload=33215]: Next returned nil segment May 26 12:45:07.250679949 (34h40m53.034020048s) [upload=33215]: Waiting for error group managing segments... May 26 12:45:07.531454635 (34h40m53.314794734s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534321906 (34h40m53.317662005s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534508562 (34h40m53.317848651s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.536279231 (34h40m53.31961934s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.541781561 (34h40m53.32512166s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.565752291 (34h40m53.34909239s) [noise=true , address=212.102.52.217:4436 , piece_id=4NDBERVDRZA62QUPGSB6YHKUDOUZJMHQRFO5ZATRI7DN32WA4BOA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566131584 (34h40m53.349471683s) [noise=true , address=212.102.52.215:4380 , piece_id=3AKIGLX2AF7QPQARHGKDD35S2WKTO77OP4CFVCJCCD4I3KJUWRAA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566578738 (34h40m53.349918837s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.572715768 (34h40m53.356055867s) [noise=true , address=212.102.52.216:4405 , piece_id=CYRXV67TFYNXLTSPPVHFKBHFLJ7SQUXVW6E7QJJVP2IO72JWK4DA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.573001394 (34h40m53.356341493s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578206936 (34h40m53.361547035s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578665933 (34h40m53.362006042s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578932330 (34h40m53.362272429s) [noise=true , address=212.102.52.213:4336 , piece_id=JHFA274T2DK5C4UMAPKWLMBB4ZLNBYTA4BYS2ZQ2KAHYO4LZAA4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.579487169 (34h40m53.362827268s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.581981168 (34h40m53.365321267s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584667704 (34h40m53.368007804s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584689156 (34h40m53.368029255s) [seg_pos={0 0}, upload=33215]: Satisfied cohort requirements after 16 pieces May 26 12:45:07.584881472 (34h40m53.368221581s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584891783 (34h40m53.368231882s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.584922872 (34h40m53.368262971s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584944583 (34h40m53.368284682s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585097405 (34h40m53.368437504s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MGexEpM3Yefmhe4mYARRJHvoGH4hNfULwt2uRgFs9fs18D9Md): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585119917 (34h40m53.368460016s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585152319 (34h40m53.368492428s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585162409 (34h40m53.368502518s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585248253 (34h40m53.368588362s) [seg_pos={0 0}, upload=33215]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:45:07.585325560 (34h40m53.368665659s) [upload=33215]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:45:07.585331842 (34h40m53.368671951s) [upload=33215]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:45:21.000413228 (34h41m6.783753337s) [upload=33215]: Done uploading segments... May 26 12:45:21.000428477 (34h41m6.783768586s) [upload=33215]: Upload finished. err: <nil> Duration: 5.464091998s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 3.873690719s trace: https://jaeger.dev.storj.io/trace/5867dddbed7af4dc FAIL (2026-05-26 12:46:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.873703173s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 6.859462122s trace: https://jaeger.dev.storj.io/trace/4c2f5e8c0d911bea FAIL (2026-05-26 12:46:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.859498632s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 6.742304025s trace: https://jaeger.dev.storj.io/trace/4c2f5e8c0d911bea FAIL (2026-05-26 12:46:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.742314965s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.001452963s trace: https://jaeger.dev.storj.io/trace/4c2f5e8c0d911bea FAIL (2026-05-26 12:45:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001461569s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.........................X....X...........................X.] duration: 4.101363319s trace: https://jaeger.dev.storj.io/trace/34a3167c93e9d452 FAIL (2026-05-26 12:45:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3KJUWRAA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.173883418 (34h40m51.957223517s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174251000 (34h40m51.957591099s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174290935 (34h40m51.957631034s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174602551 (34h40m51.95794265s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174728671 (34h40m51.95806877s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174950454 (34h40m51.958290553s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175383791 (34h40m51.95872389s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175712058 (34h40m51.959052157s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176046917 (34h40m51.959387016s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176061394 (34h40m51.959401513s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176434937 (34h40m51.959775036s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176757021 (34h40m51.96009712s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176828588 (34h40m51.960168687s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176863154 (34h40m51.960203253s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.177161373 (34h40m51.960501472s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:07.250667406 (34h40m53.034007505s) [upload=33215]: Next returned nil segment May 26 12:45:07.250679949 (34h40m53.034020048s) [upload=33215]: Waiting for error group managing segments... May 26 12:45:07.531454635 (34h40m53.314794734s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534321906 (34h40m53.317662005s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534508562 (34h40m53.317848651s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.536279231 (34h40m53.31961934s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.541781561 (34h40m53.32512166s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.565752291 (34h40m53.34909239s) [noise=true , address=212.102.52.217:4436 , piece_id=4NDBERVDRZA62QUPGSB6YHKUDOUZJMHQRFO5ZATRI7DN32WA4BOA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566131584 (34h40m53.349471683s) [noise=true , address=212.102.52.215:4380 , piece_id=3AKIGLX2AF7QPQARHGKDD35S2WKTO77OP4CFVCJCCD4I3KJUWRAA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566578738 (34h40m53.349918837s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.572715768 (34h40m53.356055867s) [noise=true , address=212.102.52.216:4405 , piece_id=CYRXV67TFYNXLTSPPVHFKBHFLJ7SQUXVW6E7QJJVP2IO72JWK4DA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.573001394 (34h40m53.356341493s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578206936 (34h40m53.361547035s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578665933 (34h40m53.362006042s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578932330 (34h40m53.362272429s) [noise=true , address=212.102.52.213:4336 , piece_id=JHFA274T2DK5C4UMAPKWLMBB4ZLNBYTA4BYS2ZQ2KAHYO4LZAA4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.579487169 (34h40m53.362827268s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.581981168 (34h40m53.365321267s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584667704 (34h40m53.368007804s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584689156 (34h40m53.368029255s) [seg_pos={0 0}, upload=33215]: Satisfied cohort requirements after 16 pieces May 26 12:45:07.584881472 (34h40m53.368221581s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584891783 (34h40m53.368231882s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.584922872 (34h40m53.368262971s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584944583 (34h40m53.368284682s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585097405 (34h40m53.368437504s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MGexEpM3Yefmhe4mYARRJHvoGH4hNfULwt2uRgFs9fs18D9Md): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585119917 (34h40m53.368460016s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585152319 (34h40m53.368492428s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585162409 (34h40m53.368502518s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585248253 (34h40m53.368588362s) [seg_pos={0 0}, upload=33215]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:45:07.585325560 (34h40m53.368665659s) [upload=33215]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:45:07.585331842 (34h40m53.368671951s) [upload=33215]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:45:21.000413228 (34h41m6.783753337s) [upload=33215]: Done uploading segments... May 26 12:45:21.000428477 (34h41m6.783768586s) [upload=33215]: Upload finished. err: <nil> Duration: 4.101375592s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..........................X....X...........................X] duration: 1m0.002257028s trace: https://jaeger.dev.storj.io/trace/34a3167c93e9d452 FAIL (2026-05-26 12:45:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 3KJUWRAA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.173883418 (34h40m51.957223517s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174251000 (34h40m51.957591099s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174290935 (34h40m51.957631034s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174602551 (34h40m51.95794265s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174728671 (34h40m51.95806877s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.174950454 (34h40m51.958290553s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175383791 (34h40m51.95872389s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.175712058 (34h40m51.959052157s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176046917 (34h40m51.959387016s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176061394 (34h40m51.959401513s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176434937 (34h40m51.959775036s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176757021 (34h40m51.96009712s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176828588 (34h40m51.960168687s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.176863154 (34h40m51.960203253s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:06.177161373 (34h40m51.960501472s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Uploading piece... May 26 12:45:07.250667406 (34h40m53.034007505s) [upload=33215]: Next returned nil segment May 26 12:45:07.250679949 (34h40m53.034020048s) [upload=33215]: Waiting for error group managing segments... May 26 12:45:07.531454635 (34h40m53.314794734s) [noise=true , address=212.102.52.217:4422 , piece_id=5DAPLRQ6JXAR7ZVIZ3TQMZUKBQ4LY4NJYEH3ZKWLSSNQ6DY7XG3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534321906 (34h40m53.317662005s) [noise=true , address=212.102.52.215:4387 , piece_id=ZDKMT2RPCY7UPUQVZFARKIW42BORNWDS5BUV47O3EX4SCXWCI2IQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.534508562 (34h40m53.317848651s) [noise=true , address=212.102.52.214:4351 , piece_id=3MMINIEVDH54UQ2VSRUQGKRWQLGEOMY6PSR5QSAOOA7X7XB7U5CQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.536279231 (34h40m53.31961934s) [noise=true , address=212.102.52.213:4329 , piece_id=IXCOW6DBJLHRVJX7XHBNSBZ5SBTFIVZUPS4VP7QDAEJ4YKWGAJ3A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.541781561 (34h40m53.32512166s) [noise=true , address=212.102.52.216:4416 , piece_id=6EBKL63GGCISIENM7D74Y5JR42ZWVUULSEDPUFN6IVK6TXF6WKIA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.565752291 (34h40m53.34909239s) [noise=true , address=212.102.52.217:4436 , piece_id=4NDBERVDRZA62QUPGSB6YHKUDOUZJMHQRFO5ZATRI7DN32WA4BOA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566131584 (34h40m53.349471683s) [noise=true , address=212.102.52.215:4380 , piece_id=3AKIGLX2AF7QPQARHGKDD35S2WKTO77OP4CFVCJCCD4I3KJUWRAA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.566578738 (34h40m53.349918837s) [noise=true , address=212.102.52.216:4411 , piece_id=2WPFP5EE74UBLHBP5NY5WTRL4AVWJUCSPY6ALGCEYL6DJM3KPOWQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.572715768 (34h40m53.356055867s) [noise=true , address=212.102.52.216:4405 , piece_id=CYRXV67TFYNXLTSPPVHFKBHFLJ7SQUXVW6E7QJJVP2IO72JWK4DA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.573001394 (34h40m53.356341493s) [noise=true , address=212.102.52.216:4393 , piece_id=XMJ5QIXQ2EQG7WEHMMSA32FMAMIBWQIJGVWCP72DLZ26NY3Y4SRQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578206936 (34h40m53.361547035s) [noise=true , address=212.102.52.217:4435 , piece_id=3MXGCBVN6N7TGMGRHE4F2SR7UFWFUMXF6F64LEBGHBAFPYB6U5UQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578665933 (34h40m53.362006042s) [noise=true , address=212.102.52.213:4328 , piece_id=DHKFJGP27IO2JG2G6TSAHS26O2XQXBGK4BO2SDP46NOLUVXB6VVQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.578932330 (34h40m53.362272429s) [noise=true , address=212.102.52.213:4336 , piece_id=JHFA274T2DK5C4UMAPKWLMBB4ZLNBYTA4BYS2ZQ2KAHYO4LZAA4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.579487169 (34h40m53.362827268s) [noise=true , address=212.102.52.214:4348 , piece_id=ZJDOAZS4B3ERZQFHZV4WNPUCLTKCBVC2GT73S7DF4M2SG52ELRZQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.581981168 (34h40m53.365321267s) [noise=true , address=212.102.52.215:4382 , piece_id=GQLFUUKEVEJJXDZVPLTWRCQBUZ5UYMDZ77CQZE5Z3AWUTCQUB6YQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584667704 (34h40m53.368007804s) [noise=true , address=212.102.52.214:4359 , piece_id=UYESE7DYK2OAUZVRTX53RCWGJIB22AQHNFFNHUJE3NAIF5MHQDMQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: <nil> May 26 12:45:07.584689156 (34h40m53.368029255s) [seg_pos={0 0}, upload=33215]: Satisfied cohort requirements after 16 pieces May 26 12:45:07.584881472 (34h40m53.368221581s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584891783 (34h40m53.368231882s) [noise=true , address=212.102.52.217:4424 , piece_id=XUUYFZSABTPPDUX2DJLFA5X4H2YM3ETGRVAZSOCEO5FWFQUALY4A, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.584922872 (34h40m53.368262971s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.584944583 (34h40m53.368284682s) [noise=true , address=212.102.52.215:4391 , piece_id=FKPRDILYQ4VOQ2JKHSZ5D2VPKXGPX344XQKKQ5L52MVKKSUT7EDQ, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585097405 (34h40m53.368437504s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MGexEpM3Yefmhe4mYARRJHvoGH4hNfULwt2uRgFs9fs18D9Md): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585119917 (34h40m53.368460016s) [noise=true , address=212.102.52.213:4327 , piece_id=XXFYMQI54GXXBHXFH4IJSS2RMO5PJQWYLD3ZFVVX734MXCHA2L2Q, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585152319 (34h40m53.368492428s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:45:07.585162409 (34h40m53.368502518s) [noise=true , address=212.102.52.214:4354 , piece_id=WZIHRENPZWQEPKAVT4XOCM3N2Z4IUABP5ELNMJKJNDUQS7HU6VWA, seg_pos={0 0}, upload=33215]: Long tail cancellation due to optimal threshold May 26 12:45:07.585248253 (34h40m53.368588362s) [seg_pos={0 0}, upload=33215]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:45:07.585325560 (34h40m53.368665659s) [upload=33215]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:45:07.585331842 (34h40m53.368671951s) [upload=33215]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:45:21.000413228 (34h41m6.783753337s) [upload=33215]: Done uploading segments... May 26 12:45:21.000428477 (34h41m6.783768586s) [upload=33215]: Upload finished. err: <nil> Duration: 1m0.002266807s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 3.831372291s trace: https://jaeger.dev.storj.io/trace/5867dddbed7af4dc FAIL (2026-05-26 12:45:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.831446202s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.00059236s trace: https://jaeger.dev.storj.io/trace/1377b1e43b559820 FAIL (2026-05-26 12:44:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000608359s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001547891s trace: https://jaeger.dev.storj.io/trace/5867dddbed7af4dc FAIL (2026-05-26 12:44:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001562458s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................X....X...........................] duration: 5.568185906s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:43:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 5.568209873s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................X....X..........................] duration: 3.921728847s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:42:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.921745007s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................X....X.........................] duration: 3.982259066s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:42:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.982284916s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................X....X........................] duration: 3.92263162s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:42:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.922644425s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................X....X.......................] duration: 4.995647696s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:41:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.99567051s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................X....X......................] duration: 4.033134182s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:40:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.03315875s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................X....X.....................] duration: 3.997066665s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:39:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.997081142s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [X.................................X....X....................] duration: 5.790412564s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:38:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 5.790430748s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.X.................................X....X...................] duration: 4.527787878s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:37:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.527808317s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..X.................................X....X..................] duration: 4.073618005s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:36:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.073632274s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...X.................................X....X.................] duration: 4.107287563s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:35:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.107311929s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....X.................................X....X................] duration: 4.154921606s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:34:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.154943638s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....X.................................X....X...............] duration: 4.067129937s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:34:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.067160955s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......X.................................X....X..............] duration: 4.118743473s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:33:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.118763963s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [X......X.................................X....X.............] duration: 4.085561966s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:33:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.085582765s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.X......X.................................X....X............] duration: 4.220189242s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:32:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.22020931s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..X......X.................................X....X...........] duration: 4.004790606s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:31:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.004813028s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...X......X.................................X....X..........] duration: 6.750518459s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:31:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 6.750541413s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [....X......X.................................X....X.........] duration: 4.185204367s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:30:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.185227008s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.....X......X.................................X....X........] duration: 3.975665531s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:29:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.975687083s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [......X......X.................................X....X.......] duration: 4.078166443s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:28:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.078185801s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.......X......X.................................X....X......] duration: 4.084462126s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:28:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.08448533s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [........X......X.................................X....X.....] duration: 4.054131173s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:27:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.054141505s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.........X......X.................................X....X....] duration: 4.422111578s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:26:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.422134553s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [..........X......X.................................X....X...] duration: 3.955839259s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:25:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 3.955856473s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [...........X......X.................................X....X..] duration: 4.097245757s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:24:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.097258792s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [............X......X.................................X....X.] duration: 4.226051661s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:23:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 4.226061919s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 4 out of 60 is failed (threshold=3) [.............X......X.................................X....X] duration: 1m0.001832785s trace: https://jaeger.dev.storj.io/trace/4efe1a1550d8f01c FAIL (2026-05-26 12:23:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== IEW3JVQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933550011 (34h18m36.71689011s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.933870231 (34h18m36.71721032s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934090642 (34h18m36.717430732s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934142401 (34h18m36.7174825s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934384492 (34h18m36.717724591s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934443104 (34h18m36.717783203s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.934749580 (34h18m36.718089689s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935119736 (34h18m36.718459835s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935349995 (34h18m36.718690094s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935401263 (34h18m36.718741362s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935574654 (34h18m36.718914753s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935745590 (34h18m36.719085689s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.935818740 (34h18m36.719158829s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936455625 (34h18m36.719795714s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:50.936843104 (34h18m36.720183203s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Uploading piece... May 26 12:22:52.001433168 (34h18m37.784773277s) [upload=32860]: Next returned nil segment May 26 12:22:52.001444260 (34h18m37.784784369s) [upload=32860]: Waiting for error group managing segments... May 26 12:22:52.282674202 (34h18m38.066014301s) [noise=true , address=212.102.52.214:4366 , piece_id=LI2UMQZTNEYPZ4RZVQ3VUEXZQU2OXPZZXQNJUWL33BCMGBLGIQPQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288494137 (34h18m38.071834236s) [noise=true , address=212.102.52.215:4374 , piece_id=NWFGVAE64FV53NVKXD6XGRQWF7GD4A5Y34UOZVZYQPCY4K5QKAWA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.288844677 (34h18m38.072184776s) [noise=true , address=212.102.52.216:4409 , piece_id=UHMUFDZSOYLCFQOJEWAQC3OFLWX5UKZ4R6EBKQWOWJDDXS45IILQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.289909258 (34h18m38.073249357s) [noise=true , address=212.102.52.214:4360 , piece_id=HYIPENVAUMTOI53HCEOWQHYLVTNWCSCMBJ36VOCTVQ2O4IEW3JVQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295077269 (34h18m38.078417368s) [noise=true , address=212.102.52.213:4327 , piece_id=RCK6ZAPNF4CQUYHVTEXI4YHIR5JHDRUZG2TJCORNB5CWUTCYWRFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.295158774 (34h18m38.078498873s) [noise=true , address=212.102.52.217:4432 , piece_id=6E4ZN66MSOWERRERRQSSOESCWZXXEOTTFMU3PUKPXLFXOYW7ROOA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.299045430 (34h18m38.082385549s) [noise=true , address=212.102.52.217:4437 , piece_id=QMEGAVGXUPJJUWKOORLYB7CHOYCUSATGINQL4P6XVMLYB6AIQAVA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.311888868 (34h18m38.095228957s) [noise=true , address=212.102.52.213:4321 , piece_id=EPFSDWARMRZPYFCO6ZY73IHUE5D36WLMOWS6QX4ZVQ7R5DA3RUUQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321216666 (34h18m38.104556756s) [noise=true , address=212.102.52.217:4439 , piece_id=73WRJ6YX5VKF3MC5XRO5CACPQ3CXUXONX7ED3VTQ4SGZDYCU4ESA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.321638181 (34h18m38.10497828s) [noise=true , address=212.102.52.213:4325 , piece_id=D6CUJCOBHW5PWAV3BTNYN5MH6O3CIKLTBOCEWBPZS2ISEZNZOF4A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.322839002 (34h18m38.106179101s) [noise=true , address=212.102.52.217:4421 , piece_id=ETFPHZKQ2UYCRCLA2A4AL5EBXULYNSG5HZWNP4JI446G6U5EFWTQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.328069052 (34h18m38.111409151s) [noise=true , address=212.102.52.216:4393 , piece_id=TQZ45ZXEB6IX3YLSZD73OF7NZGHQJC4U27ONZY22G2SO6V3AFEXA, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.331712434 (34h18m38.115052533s) [noise=true , address=212.102.52.215:4380 , piece_id=UNMNFYF6AN2QWJZK24ULHEIZF3GBNBXQFUJKSF27IOKIIBXW5JXQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.347417090 (34h18m38.130757189s) [noise=true , address=212.102.52.215:4375 , piece_id=ED743ZYF4E74WC5RHL4S5JIBOVEYTPZCQ2TLXDG7UPQ2Y2H2O3RQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349153033 (34h18m38.132493132s) [noise=true , address=212.102.52.214:4357 , piece_id=K3NGI7FOHSE6M6U7XXMOVKLUEHHP2OJR474FDMZPBDEZCG42DE7A, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349959632 (34h18m38.133299731s) [noise=true , address=212.102.52.216:4396 , piece_id=YXW3IBX5B5JAMHVCZPPRIAFLIDCCWIM2NNQ6LFD5DVXONIEH2E3Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: <nil> May 26 12:22:52.349968829 (34h18m38.133308929s) [seg_pos={0 0}, upload=32860]: Satisfied cohort requirements after 16 pieces May 26 12:22:52.350182487 (34h18m38.133522586s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tTPVkbPU79Nu2YCb8QpDDCPuJEYotqgVHPWwcHXC5hAqMnsBd): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350197766 (34h18m38.133537865s) [noise=true , address=212.102.52.215:4372 , piece_id=MAPR7DCM77WC6ATUJN4JYK5FO6KJVOE7SALTWYBR2UVW2EV5IGCQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350211613 (34h18m38.133551702s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SUcotB1144nMnt3JXXbVyNoz9aS6352uH9cGptt4RqKbvQkRv): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350217925 (34h18m38.133558014s) [noise=true , address=212.102.52.213:4339 , piece_id=FLJIZR6DDJXYAZHVKFWXXFGV5OKYS5ASG4QRFTYFGGCMENEMMAFQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350306043 (34h18m38.133646142s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v7RCaWKsXn5ummw3iuCB5kGNH2SEvA3AedxJ5zdUj4vX3U8bn): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350312615 (34h18m38.133652714s) [noise=true , address=212.102.52.216:4406 , piece_id=HY7Y2K63PKW3VZR4UXDUZ6U7J7GL33SJDVKQOWYPBDSVJT3K7BBQ, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350321573 (34h18m38.133661662s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1286SqXMbtXfUYTRS8gDRUVFNfWEimRFetY3Z7WgZCgBwxox9R6): protocol: expected piece hash; context canceled; EOF May 26 12:22:52.350327193 (34h18m38.133667292s) [noise=true , address=212.102.52.214:4354 , piece_id=YNOS6VEYWG4BHHRKRHAYUHTXYWXJQAHJBGM6JYWJTHBSOR7XYH6Q, seg_pos={0 0}, upload=32860]: Long tail cancellation due to optimal threshold May 26 12:22:52.350392408 (34h18m38.133732507s) [seg_pos={0 0}, upload=32860]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:22:52.350484253 (34h18m38.133824352s) [upload=32860]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:22:52.350504021 (34h18m38.13384411s) [upload=32860]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:23:25.195126860 (34h19m10.978466959s) [upload=32860]: Done uploading segments... May 26 12:23:25.195144604 (34h19m10.978484703s) [upload=32860]: Upload finished. err: <nil> Duration: 1m0.001854285s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..............X......X.................................X....] duration: 4.164198133s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:22:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.164229762s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...............X......X.................................X...] duration: 4.18729239s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:21:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.187327057s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [................X......X.................................X..] duration: 4.216925807s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:20:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.216983207s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.................X......X.................................X.] duration: 7.318581774s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:20:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.318592023s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..................X......X.................................X] duration: 1m3.109927733s trace: https://jaeger.dev.storj.io/trace/75b508fa4998aa64 FAIL (2026-05-26 12:20:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =32801]: Uploading piece... May 26 12:19:31.716941461 (34h15m17.50028156s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717202910 (34h15m17.500543009s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717209863 (34h15m17.500549962s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717457876 (34h15m17.500797975s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717560773 (34h15m17.500900872s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717839194 (34h15m17.501179283s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.717884921 (34h15m17.50122502s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718141300 (34h15m17.5014814s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718208198 (34h15m17.501548287s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718532437 (34h15m17.501872536s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.718878607 (34h15m17.502218706s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719174882 (34h15m17.502514971s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719492419 (34h15m17.502832518s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.719784156 (34h15m17.503124255s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:31.720031868 (34h15m17.503371957s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Uploading piece... May 26 12:19:32.784571496 (34h15m18.567911595s) [upload=32801]: Next returned nil segment May 26 12:19:32.784582568 (34h15m18.567922667s) [upload=32801]: Waiting for error group managing segments... May 26 12:19:33.062237028 (34h15m18.845577127s) [noise=true , address=212.102.52.217:4422 , piece_id=5GSTTHDL5KJLLOEEKPRDR4ALMQRJS7TR3OWRRBPWI4W6MW6PTLBA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.064059716 (34h15m18.847399815s) [noise=true , address=212.102.52.214:4348 , piece_id=ODTUOV7TRRSO5EONFHQSKIEE6P2ZXZVHTYOF52P3Z6OYYZH6AH3A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.069664922 (34h15m18.853005011s) [noise=true , address=212.102.52.217:4440 , piece_id=ZEKBZTSKD54RTDEMPDFAQF6HNNHMFILY7NUXTTBACEDFRXDUXCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.075595288 (34h15m18.858935387s) [noise=true , address=212.102.52.213:4332 , piece_id=QWOVHF52QDFKFIQUD3N6DOGRAZZXMFF66GE7GOO6LPC225MJMYWA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.076790227 (34h15m18.860130326s) [noise=true , address=212.102.52.216:4413 , piece_id=E4JSJJFL3M42V7PC24QLWBFCDRVHQ7AH2ZX235B44CUY4QQYZCIA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.078552991 (34h15m18.86189309s) [noise=true , address=212.102.52.216:4393 , piece_id=PEPRXU3OY327CCBWLLK2MWGPETCKZ4OURWEWA65UYRPOV6J46WFA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110167946 (34h15m18.893508085s) [noise=true , address=212.102.52.214:4346 , piece_id=M77OWJXNJDC7PQPIWF7ETB7SXA4MIT2S6B5R6F56YYGWVC33HIMQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.110318544 (34h15m18.893658633s) [noise=true , address=212.102.52.213:4331 , piece_id=E6TKWX5TC4RPER7RD3V7XDZFJUBXB5Z2DNBMIFCSWSNOGHHXUWNA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111555875 (34h15m18.894895974s) [noise=true , address=212.102.52.214:4360 , piece_id=4O462KAS5NDNF2OS56LIM23LZUMDFF6PPX3DNS2J4YOVS72FI5NQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.111803587 (34h15m18.895143676s) [noise=true , address=212.102.52.215:4389 , piece_id=ZWMP5HZ46SCGWGYG5YFUOBAWIJYH7SC7LMXP2WRCDN56VHY7MMOA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.114217373 (34h15m18.897557472s) [noise=true , address=212.102.52.216:4411 , piece_id=XVTGPIXYPVJCVGQXAKSVZXH6CAJZUZM6BU2XLRHQY5HVHCUTOL4Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.116598127 (34h15m18.899938226s) [noise=true , address=212.102.52.215:4382 , piece_id=K4HENFKKVM6U2OFDX5RDRT4RQF76YRXQ6YT3R7W2IDRMUQM7RJKQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.117364549 (34h15m18.900704638s) [noise=true , address=212.102.52.215:4374 , piece_id=5PJXH7J3GPQANUTHRNASWS7IIOPK6ZCEYTQV7HJCHNDFUTFXLLYA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118288161 (34h15m18.90162826s) [noise=true , address=212.102.52.217:4435 , piece_id=B6XPVKZCMSCTYFXH6PLHYJZFZMCDEP34IC4NTLRNB7BJKBU2GY3Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.118389785 (34h15m18.901729894s) [noise=true , address=212.102.52.214:4351 , piece_id=HPEPPDU2RQL4EOB5IPV6V27RBKC7TCBBAQJ76P54IWDUKVZEK5KQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121953905 (34h15m18.905294004s) [noise=true , address=212.102.52.217:4423 , piece_id=Y545RC3YMIHHHSNS5OSA2SXTXJFZ5HDI6OF6J5JF5N4N6IQ3MI6Q, seg_pos={0 0}, upload=32801]: Done uploading piece. err: <nil> May 26 12:19:33.121969375 (34h15m18.905309544s) [seg_pos={0 0}, upload=32801]: Satisfied cohort requirements after 16 pieces May 26 12:19:33.122163295 (34h15m18.905503394s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJ3Cc6SDXz1kVAonxneo6cmqGJSyarDuB7mnLpk3jptn72B97): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122184926 (34h15m18.905525025s) [noise=true , address=212.102.52.216:4402 , piece_id=4P6F5A75M77EK7FNY43HV54H4J26UIBAZAKVNJF5V7OHEBXQ2TMA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122219532 (34h15m18.905559641s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K65J7VCBmysqtxarNThUGarMstzQxGicA9LN4EbXhyDSR64mh): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122231184 (34h15m18.905571323s) [noise=true , address=212.102.52.213:4341 , piece_id=ZYQH7GINHGIDJAP7VYYWZV4UHEUNYBJ6OSF6WQWHOOQY3MVOVFLQ, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122440644 (34h15m18.905780743s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ba2xzEg4HQRMyHzTfny9mKtSRRrs9upRgRdax4U3RWwG8w7g7): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122448329 (34h15m18.905788428s) [noise=true , address=212.102.52.213:4337 , piece_id=34OOL4CUUNHYVYFQEVRZPFVAH7YIUCOFY7JG6LITXSY53F5OFR2A, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122460963 (34h15m18.905801052s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tz4zmQwQuZRv11trxzYvGvc7UHKHaz9edHsd6KPeK3V4usmUr): protocol: expected piece hash; context canceled; EOF May 26 12:19:33.122468277 (34h15m18.905808376s) [noise=true , address=212.102.52.215:4387 , piece_id=RG3MXKNR2EX7O5ET2AGZH5UCBM4L4XIX55USAMNVW3MSU3DFSKGA, seg_pos={0 0}, upload=32801]: Long tail cancellation due to optimal threshold May 26 12:19:33.122484839 (34h15m18.905824928s) [seg_pos={0 0}, upload=32801]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 26 12:19:33.122574470 (34h15m18.905914569s) [upload=32801]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 26 12:19:33.122580351 (34h15m18.90592048s) [upload=32801]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 26 12:20:00.406268993 (34h15m46.189609092s) [upload=32801]: Done uploading segments... May 26 12:20:00.406311565 (34h15m46.189651664s) [upload=32801]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m3.109944906s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................X......X.................................] duration: 4.254926785s trace: https://jaeger.dev.storj.io/trace/212a008cd4977242 FAIL (2026-05-26 12:18:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== May 26 11:53:52.802227335 (33h49m38.585567434s) [upload=32397]: Starting upload May 26 11:53:52.802261710 (33h49m38.585601799s) [upload=32397]: Done starting upload May 26 11:53:52.802318218 (33h49m38.585658317s) [upload=32397]: Uploading segments... May 26 11:53:52.802509853 (33h49m38.585849962s) [upload=32397]: Got next segment. Inline: false May 26 11:53:52.802535192 (33h49m38.585875291s) [upload=32397]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 26 11:53:52.802538969 (33h49m38.585879068s) [upload=32397]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 26 11:54:32.191523004 (33h50m17.974863103s) [upload=32397]: Next segment err: context deadline exceeded May 26 11:54:32.191778802 (33h50m17.975118901s) [upload=32397]: Done uploading segments... May 26 11:54:32.191812175 (33h50m17.975152274s) [upload=32397]: Upload finished. err: context deadline exceeded Duration: 4.254938357s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)